-- Logs begin at Wed 2022-05-11 19:59:17 UTC, end at Wed 2022-05-11 21:23:59 UTC. -- May 11 20:55:44.863533 dv-cinder-841467-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 20:55:44.872721 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 20:55:44 2022] *** May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: nodename: dv-cinder-841467-1-iscsi May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: machine: x86_64 May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: clock source: unix May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: pcre jit disabled May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: detected number of CPU cores: 4 May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: current working directory: / May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: detected binary path: /usr/bin/uwsgi-core May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: your processes number limit is 47680 May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: your memory page size is 4096 bytes May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: detected max file descriptor number: 2048 May 11 20:55:44.874426 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: lock engine: pthread robust mutexes May 11 20:55:44.875309 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: thunder lock: enabled May 11 20:55:44.875309 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 20:55:44.875309 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 20:55:44.919929 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: Python main interpreter initialized at 0x5587cc79d9c0 May 11 20:55:44.919929 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: python threads support enabled May 11 20:55:44.919929 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: your server socket listen backlog is limited to 100 connections May 11 20:55:44.919929 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: your mercy for graceful operations on workers is 90 seconds May 11 20:55:44.920281 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: mapped 403077 bytes (393 KB) for 2 cores May 11 20:55:44.920359 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: *** Operational MODE: preforking *** May 11 20:55:44.920595 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: *** uWSGI is running in multiple interpreter mode *** May 11 20:55:44.920595 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: spawned uWSGI master process (pid: 103263) May 11 20:55:44.920783 dv-cinder-841467-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 20:55:44.922335 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: spawned uWSGI worker 1 (pid: 103264, cores: 1) May 11 20:55:44.922335 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: spawned uWSGI worker 2 (pid: 103265, cores: 1) May 11 20:55:44.922335 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 20:55:46.124362 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 20:55:46.124933 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 20:55:46.850312 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:55:46.850312 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes May 11 20:55:46.850642 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:55:46.850642 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: from cryptography.utils import int_from_bytes May 11 20:55:46.850866 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:55:46.850866 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: from cryptography.utils import int_from_bytes May 11 20:55:46.851205 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:55:46.851205 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: from cryptography.utils import int_from_bytes May 11 20:55:49.419920 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 20:55:49.420477 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 20:55:49.420683 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 20:55:49.421048 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 20:55:49.421309 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 20:55:49.421726 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.422060 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.422386 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.422712 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.423047 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.424024 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.424357 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.424683 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.425016 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.425282 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.425566 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 20:55:49.425955 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.426045 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 20:55:49.426125 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841467-1-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.426266 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.426399 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 20:55:49.426581 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.426687 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 20:55:49.426897 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.426995 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 20:55:49.427220 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.427316 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.427529 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.427626 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.427854 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.427943 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.428165 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.428262 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.428572 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.428674 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.428895 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.429095 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.429245 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.429410 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.429579 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.429736 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.429911 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.430076 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.430167 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.430394 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.430482 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.430707 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.430815 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841467-1-iscsi {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.431033 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.431127 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.431346 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.431437 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.431669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.431797 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.431978 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.432161 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.432323 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.432452 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841467-1-iscsi {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.432661 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.432801 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.432976 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.433102 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.433293 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.433482 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.433728 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.433870 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.434043 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.434175 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.434355 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.434481 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.434677 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.434805 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.435000 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.435128 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.435311 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.435444 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.435642 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.435776 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.435963 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.436104 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.436283 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.436434 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.436608 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.436724 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.436915 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.437050 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841467-1-iscsi {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.437225 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.437391 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.437552 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.437727 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.437906 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.438051 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.438168 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.438467 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.438557 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.438721 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.438857 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.439057 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.439186 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.439381 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.439517 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.439704 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.439840 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440035 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440175 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440299 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440429 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440562 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440687 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440809 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.440980 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.441132 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.441306 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.441443 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.441640 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.441769 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.441956 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.442094 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.442273 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.442402 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.442605 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.442739 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.442918 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.443046 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.443223 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.443350 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.443494 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.443620 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.443814 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.443950 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.444138 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.444263 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.444460 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.444594 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.444767 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.444904 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.445070 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.445219 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.445344 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.445467 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.445664 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.445796 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.445992 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.446123 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.446306 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.446434 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.446643 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.446848 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.446987 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.447117 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.447241 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.447363 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.447551 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.447678 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.447856 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.447982 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.448165 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.448290 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.448470 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.448596 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.448790 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.448914 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.449110 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.449249 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.449417 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.449573 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.449699 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.449912 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.450040 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.450277 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.450413 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.450592 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.450768 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.450895 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.451077 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.451214 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.451397 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.451524 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.451742 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.451869 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.452061 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.452196 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.452369 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.452508 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.452676 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.452803 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.452984 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.453114 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.453295 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.453429 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.453624 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.453752 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.453936 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.454062 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.454239 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.454375 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.454548 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.454675 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.454893 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.455033 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.455157 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.455287 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.455440 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.455575 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.455752 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.455880 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.456094 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.456233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.456402 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.456539 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.456718 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.456861 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.457048 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.457181 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.457313 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.457437 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.457641 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.457769 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.457950 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.458082 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.458256 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.458392 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.458563 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.458689 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.458872 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.458999 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.459179 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.459312 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.459492 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.459618 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.459791 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.459923 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.460099 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.460227 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.460419 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.460546 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.460728 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.460854 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.461036 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.461177 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.461343 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.461469 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.461677 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.461815 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.461981 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.462116 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.462290 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.462416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.462596 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.462730 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.462904 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.463036 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.463202 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.463328 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.463526 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.463653 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.463848 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.463982 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.464159 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.464291 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.464468 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.464592 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.464794 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.464919 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.465077 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.465203 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.465381 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.465507 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.465723 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.465864 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.466049 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.466185 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.466361 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.466488 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.466676 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.466805 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.467095 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.467231 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.467353 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.467484 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.467645 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.467775 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.467965 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.468092 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.468274 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.468412 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.468589 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.468722 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.468897 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.469023 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.469211 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.469345 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.469571 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.469699 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.469880 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.470018 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.470712 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.470855 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.471040 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.471167 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.471358 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.471484 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:55:49.471682 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.471810 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.472000 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.472127 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.472321 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.472447 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.472652 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.472780 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.472977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.473111 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.473290 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.473443 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.473657 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.473793 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.473982 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.474109 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.474306 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.474433 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.474630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.474757 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.474949 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.475076 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.475262 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.475389 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.475577 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.475706 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.475893 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.476020 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.476220 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.476348 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.476557 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.476683 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.476876 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.477002 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.477315 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.477472 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.477648 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.477773 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.477896 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.478033 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.478158 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.478291 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.478439 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.478575 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.478754 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.478883 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.479093 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.479230 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.479410 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.479536 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.479728 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.479858 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.480044 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.480183 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.480368 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.480503 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.480685 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.480938 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.481065 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.481286 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.481421 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.481617 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.481744 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.481930 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.482072 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.482238 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.482366 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.482553 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.482690 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.482863 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.482998 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.483185 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.483320 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.483514 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.483643 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.483832 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.483968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.484166 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.484293 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.484477 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.484612 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.484792 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.484929 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.485108 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.485236 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.485424 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.485598 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.485759 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.485952 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.486648 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.486777 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.486967 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.487095 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.487278 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.487428 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.487626 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.487763 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.487909 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.488036 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.488217 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.488346 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.488543 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.488672 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.488852 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.488987 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.489187 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.489302 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.489463 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.489609 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.489803 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.489941 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.490118 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.490247 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.490433 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.490561 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.490750 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.490889 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.491078 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.491213 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.491393 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.491535 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.491709 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.491846 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.492049 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.492177 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.492368 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.492495 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.492678 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.492817 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.492996 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.493123 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.493314 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.493442 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.493656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.493785 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.493974 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.494102 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.494283 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.494416 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.494588 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.494715 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.494898 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.495026 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.495208 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.495335 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.495519 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.495659 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.495827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.495962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.496137 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.496273 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.496446 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.496574 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.496755 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.496882 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.497064 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.497201 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.497386 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.497512 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.497732 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.497870 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.498017 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.498154 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.498329 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.498457 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.498637 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.498765 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.498981 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.499117 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.499290 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.499421 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.499632 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.499767 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.499968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.500103 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.500287 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.500414 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.500614 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.500742 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.500930 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.501091 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.501251 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.501406 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.501630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.501761 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.501967 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.502099 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.502259 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.502386 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.502574 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.502701 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.502901 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.503037 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.503216 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.503343 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.503573 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.503713 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.503846 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.503971 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.504172 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.504301 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.504487 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.504629 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.504809 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.504936 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.505121 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.505249 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.505443 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.505765 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.505896 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.506135 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.506260 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.506458 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.506641 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.506769 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.506975 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.507102 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.507312 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.507447 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.507637 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.507849 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.507984 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.508108 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.508286 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.508420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.508602 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.508739 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.508925 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.509053 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.509239 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.509374 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.509584 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.509716 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.509903 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.510031 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.510228 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.510355 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.510542 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.510671 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.510863 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.510991 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.511172 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.511299 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.511489 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.511618 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.511807 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.511941 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.512133 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.512270 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.512442 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.512569 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.512759 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.512895 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.513084 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.513228 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.513399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.513545 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.513743 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.513870 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.514060 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.514248 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.514375 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.514502 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.514666 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.514801 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.514980 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.515202 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.515330 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.515547 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.515675 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.515895 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.516022 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.516206 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.516334 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.516524 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.516663 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.516838 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.516976 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.517737 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.517969 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.518112 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.518293 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.518423 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.518626 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.518755 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.518945 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.519073 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.519272 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.519401 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.519599 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.519724 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.519885 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.520013 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.520195 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.520324 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.520522 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.520650 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.520838 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.521018 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.521149 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.521264 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.521445 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.521590 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.521779 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.521940 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.522124 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.522260 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.522702 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.522839 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.523013 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.523158 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.523336 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.523485 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.523662 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.523811 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.524008 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.524132 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.524304 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.524447 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.524619 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.524771 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.524935 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.525090 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.525261 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.525402 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.525598 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.525751 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.525924 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.526304 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.526413 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.526638 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.526736 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.526961 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.527060 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.527276 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.527379 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.527602 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.527698 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.527913 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.527999 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.528223 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.528320 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.528534 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.528621 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.528843 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.528931 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.529153 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.529250 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.529466 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.529570 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.529837 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.530061 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.530167 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.530401 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.530490 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.530724 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.530813 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.531050 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.531146 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.531376 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.531476 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.531698 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.531787 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.532033 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.532131 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.532348 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.532436 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.532668 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.532826 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.533587 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.533697 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.533971 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.534081 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.534317 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.534413 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.534631 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.534720 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.534949 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.535039 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.535260 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.535348 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.535570 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.535658 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.535879 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.535969 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.536195 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.536282 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.536505 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.536602 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.536812 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.536900 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.537121 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.537220 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.537425 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.537556 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.537766 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.537855 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.538076 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.538354 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.538443 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.538682 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.538770 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.539008 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.539096 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.539322 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.539418 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.539630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.539724 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.539937 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.540038 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.540244 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.540342 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.540586 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.540674 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.540893 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.540982 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.541234 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.541337 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.541589 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.541690 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.541927 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.542016 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.542238 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.542332 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.542549 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.542639 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.542860 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.542947 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.543171 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.543257 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.543478 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.543566 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.543780 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.543866 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.544094 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.544182 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.544399 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.544488 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.544706 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.544792 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.545014 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.545176 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.545324 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.545412 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.545663 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.545765 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.545980 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.546082 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.546287 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.546389 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.546601 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.546688 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.546907 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.547004 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.547213 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.547301 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.547521 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.547609 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.547827 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.547924 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.548130 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.548216 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.548473 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.548562 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.548787 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.548890 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.549096 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.549219 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.549411 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.549596 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.549751 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.549917 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.550075 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.550234 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.550383 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.550569 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.550692 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.550883 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.551001 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.551196 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.551315 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.551508 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.551618 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.551829 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.551928 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.552145 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.552234 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.552481 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.552580 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.552799 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.552898 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.553117 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.553215 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.553427 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.553515 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.553763 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.553865 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.554071 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.554159 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.554388 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.554485 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.554699 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.554794 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.555016 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.555103 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.555324 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.555414 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.555630 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.555725 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.555934 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.556031 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.556243 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.556331 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.556550 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.556638 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.556859 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.556956 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.557162 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.557249 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.557468 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.557576 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.557801 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.557902 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.558108 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.558198 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.558414 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.558502 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.558724 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.558827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.559040 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.559136 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.559351 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.559465 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.559662 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.559752 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.559967 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.560109 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.560298 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.560394 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.560602 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.560691 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.560910 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.560998 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.561229 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.561321 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.561567 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.561679 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.561897 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.561992 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.562225 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.562320 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.562510 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.562618 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.562827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.562917 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.563135 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.563239 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.563448 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.563543 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.563761 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.563851 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.564107 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.564204 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.564423 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.564511 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.564729 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.564817 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.565053 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.565151 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.565366 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.565454 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.565701 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.565790 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.566022 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.566122 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.566337 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.566428 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.566661 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.566747 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.566970 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.567073 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.567280 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.567366 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.567592 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.567678 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.567898 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.567993 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.568205 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.568687 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.568772 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.568861 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.568953 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.569035 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.569125 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.569208 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.569413 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.569503 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.569754 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.569845 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.570123 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.570211 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.570440 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.570542 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.570755 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.570844 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.571068 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.571165 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.571374 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.571475 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.571691 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.571778 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.572003 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.572101 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.572309 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.572407 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.572619 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.572721 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.572929 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.573018 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.573244 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.573341 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.573567 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.573676 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.573921 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.574014 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.574246 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.574331 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.574591 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.574691 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.574904 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.574994 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.575218 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.575317 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.575528 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.575619 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.575863 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.575953 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.576181 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.576271 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.576491 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.576583 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.576806 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.576905 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.577126 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.577218 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.577509 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.577623 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.577811 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.577901 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.578092 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.578187 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.578407 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.578500 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.578716 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.578819 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.579030 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.579121 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.579333 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.579431 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.580231 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.580344 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.580481 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.580579 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.580790 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.580887 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.581099 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.581198 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.581418 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.581507 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.581765 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.581868 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.582082 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.582180 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.582453 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.582555 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.582818 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.582907 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.583137 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.583228 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.583450 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.583549 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.583768 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.583867 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.584085 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.584178 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.584409 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.584506 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.584723 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.584822 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.585031 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.585121 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.585342 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.585440 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.585760 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.585852 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.586086 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.586177 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.586396 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.586488 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.586702 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.586801 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.587007 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.587098 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.587322 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.587420 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.587644 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.587745 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.587951 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.588049 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.588262 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.588360 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.588573 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.588677 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.588901 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.589006 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.589212 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.589304 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.589550 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.589643 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.589918 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.590031 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.590229 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.590328 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.590540 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.590632 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.590867 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.591033 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.591178 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.591331 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.591487 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.591631 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.591814 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.591962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.592141 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.592283 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.592439 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.592608 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.592750 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.592921 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.593063 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.593240 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.593372 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.593578 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.593686 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.593914 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.594004 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.594250 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.594349 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.594568 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.594667 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.594890 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.594980 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.595266 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.595848 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.596152 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.596241 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.596463 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.596553 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.596792 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.596881 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.597106 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.597196 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.597415 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.597612 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.597758 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.597953 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.598059 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.598272 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.598397 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.598602 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.598691 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.598959 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.599050 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.599277 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.599374 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.599593 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.599683 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.599928 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.600018 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.600245 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.600340 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.600562 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.600654 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.600884 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.600973 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.601195 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.601283 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.601514 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.601629 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.601844 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.601933 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.602150 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.602249 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.602460 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.602559 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.602765 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.602861 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.603076 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.603166 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.603384 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.603480 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.603693 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.603780 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.604000 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.604089 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.604307 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.604403 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.604611 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.604734 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.604940 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.605051 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.605247 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.605385 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.605592 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.605734 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.605909 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.606050 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.606223 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.606366 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.606510 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.606680 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.606815 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.607030 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.607159 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.607342 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.607466 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.607672 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.607801 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.608011 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.608111 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.608348 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.608438 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.608669 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.608758 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.609009 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.609107 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.609349 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.609438 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.609694 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.609822 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.610016 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.610227 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.610324 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.610561 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.610650 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.610902 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.611004 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.611236 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.611325 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.611574 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.611661 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.611891 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.611988 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.612212 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.612323 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.612530 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.612660 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.612854 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.613002 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.613318 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.613413 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.613656 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.613748 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.613971 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.614061 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.614307 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.614404 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.614619 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.614716 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.614943 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.615033 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.615257 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.615346 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.615568 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.615656 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.615885 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.615976 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.616191 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.616293 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.616503 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.616628 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.616831 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.616921 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.617159 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.617248 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.617479 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.617606 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.617835 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.617925 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.618171 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.618271 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.618490 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.618586 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.618814 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.618909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.619133 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.619221 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.619456 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.619554 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.619781 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.619871 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.620094 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.620182 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.620414 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.620513 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.620731 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.620820 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.621052 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.621161 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.621368 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.621465 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.621708 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.621799 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.622029 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.622118 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.622347 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.622438 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.622665 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.622869 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.622980 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.623205 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.623335 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.623940 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624085 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624186 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624270 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624364 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624448 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624529 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624618 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624781 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.624872 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.625105 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.625196 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.625449 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.625591 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.625802 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.625996 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.626147 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.626317 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.626509 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.626679 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.626844 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.627008 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.627180 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.627337 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.627526 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.627659 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.627856 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.627980 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.628184 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.628307 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.628511 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.628600 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.628839 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.628937 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.629210 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.629297 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.629539 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.629643 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.629855 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.629955 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.630177 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.630266 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.630489 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.630577 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.630799 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.630888 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.631117 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.631204 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.631426 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.631523 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.631747 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.631959 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.632071 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.632309 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.632397 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.632630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.632720 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.632960 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.633048 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.633289 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.633379 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.633634 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.633728 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.633949 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.634038 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.634276 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.634378 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.634590 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.634680 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.634907 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.634995 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.635230 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.635351 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.635548 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.635842 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.635939 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.636152 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.636240 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.636470 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.636568 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.636786 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.636883 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.637097 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.637186 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.637414 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.637504 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.637747 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.637840 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.638078 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.638181 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.638390 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.638477 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.638697 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.638785 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.639007 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.639109 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.639322 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.639410 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.639627 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.639715 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.639937 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.640039 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.640244 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.640334 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.640552 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.640648 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.640866 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.640968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.641175 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.641273 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.641487 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.641737 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.641841 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.642623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.642718 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.642937 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.643021 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.643250 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.643350 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.643594 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.643682 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.643916 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.644004 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.644225 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.644322 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.644532 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.644621 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.644854 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.644950 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.645166 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.645263 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.645486 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.645594 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.645823 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.645913 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.646138 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.646230 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.646446 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.646541 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.646768 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.646859 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.647089 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.647315 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.647665 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.647921 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.648019 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.648251 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.648395 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.648590 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.648688 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.648910 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.649016 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.649222 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.649323 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.649574 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.649669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.649866 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.649954 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.650177 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.650268 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.650493 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.650582 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.650806 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.650903 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.651116 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.651205 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.651428 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.651515 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.651737 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.651826 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.652051 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.652141 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.652366 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.652455 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.652681 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.652770 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.652995 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.653089 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.653319 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.653410 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.653657 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.653768 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.653974 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.654077 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.654293 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.654414 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.654641 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.654740 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.654964 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.655053 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.655285 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.655402 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.655605 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.655801 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.655926 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.656125 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.656227 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.656456 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.656559 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.656836 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.656923 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.657150 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.657246 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.657478 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.657764 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.658450 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.658627 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.658772 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.658965 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.659084 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.659311 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.659502 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.659678 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.659819 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.660022 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.660144 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.660342 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.660469 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.660681 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.660778 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.661037 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.661136 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.661383 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.661474 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.661727 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.661816 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.662053 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.662152 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.662369 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.662459 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.662699 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.662787 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.663038 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.663140 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.663370 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.663467 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.663696 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.663786 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.664004 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.664094 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.664312 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.664409 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.664619 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.664708 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.664940 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.665037 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.665256 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.665343 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.665595 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.665690 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.665908 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.666000 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.666216 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.666306 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.666530 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.666632 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.666839 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.666936 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.667149 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.667245 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.667456 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.667557 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.667763 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.667860 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.668076 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.668173 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.668383 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.668481 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.668690 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.668778 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.668996 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.669116 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.669302 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.669459 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.669631 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.669987 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.670081 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.670253 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.670353 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.670558 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.670648 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.670868 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.670957 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.671177 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.671395 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.671485 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.671733 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.671822 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.672067 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.672156 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.672405 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.672495 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.672720 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.672808 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.673046 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.673168 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.673385 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.673549 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.673742 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.673907 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.674058 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.674250 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.674384 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.674597 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.674694 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.674938 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.675028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.675261 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.675351 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.675585 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.675694 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.675941 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.676037 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.676257 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.676373 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.676573 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.676758 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.676889 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.677079 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.677208 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.677393 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.677538 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.677752 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.677878 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.678067 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.678208 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.678406 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.678520 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.678722 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.678851 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.679073 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.679163 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.679412 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.679502 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.679748 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.679847 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.680079 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.680168 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.680406 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.680494 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.680721 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.680820 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.681038 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.681129 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.681357 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.681447 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.681698 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.681803 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.682016 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.682113 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.682335 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.682426 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.682656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.682756 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.682986 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.683075 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.683294 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.683383 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.683629 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.683727 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.683959 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.684048 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.684302 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.684390 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.684615 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.684705 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.684963 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.685052 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.685290 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.685387 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.685634 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.685726 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.685952 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.686041 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.686261 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.686361 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.686509 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 20:55:49.686631 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.686954 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.687298 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.687620 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.687955 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.688286 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.688627 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.688976 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.689304 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.689665 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.690006 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.690325 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.690681 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.691029 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.691364 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.691690 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.692013 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.692351 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.692695 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.693016 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.693378 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.693728 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.694060 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.694390 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.694742 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.695086 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.695455 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.695815 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.696173 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.696530 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.696856 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.697229 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.697586 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.697915 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.698236 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.698572 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:55:49.698825 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103265) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 20:55:49.710505 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:49.727860 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:49.775376 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.context [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1807c78b-3bd1-4707-b15d-964e45f54afd(cell1) {{(pid=103264) load_cells /opt/stack/nova/nova/context.py:464}} May 11 20:55:49.779691 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 20:55:49.781254 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 20:55:49.782065 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 20:55:49.784661 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 20:55:49.792891 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.context [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1807c78b-3bd1-4707-b15d-964e45f54afd(cell1) {{(pid=103265) load_cells /opt/stack/nova/nova/context.py:464}} May 11 20:55:49.795580 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:49.797316 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 20:55:49.799002 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 20:55:49.799382 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:49.799809 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 20:55:49.801805 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_concurrency.lockutils [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103265) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 20:55:49.814936 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:49.818377 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:49.960403 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_db.sqlalchemy.engines [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:49.981704 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG oslo_db.sqlalchemy.engines [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103265) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:55:50.385343 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 20:55:50.392693 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 20:55:50.401665 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 20:55:50.408982 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 20:55:50.732577 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 20:55:50.739139 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: WARNING keystonemiddleware.auth_token [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 20:55:50.745147 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587cc79d9c0 pid: 103264 (default app) May 11 20:55:50.747204 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:55:50.748365 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] 10.222.0.35 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 May 11 20:55:50.748778 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 788 bytes} [Wed May 11 20:55:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:55:50.750271 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 20:55:50.756405 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: WARNING keystonemiddleware.auth_token [None req-7291538a-d0fd-4e3e-8620-025c6b6af416 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 20:55:50.762560 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587cc79d9c0 pid: 103265 (default app) May 11 20:57:11.115613 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:11.116620 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 11 20:57:11.117259 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 2/2] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:11.538636 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-6ebd57d8-73e1-432e-9dc4-46e30501102a admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:11.568423 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-6ebd57d8-73e1-432e-9dc4-46e30501102a admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444296 May 11 20:57:11.569196 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 1/3] 10.222.0.35 () {60 vars in 1291 bytes} [Wed May 11 20:57:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:57:13.829932 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:13.832093 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-34641e33-4a64-4342-b61e-3e6b7318d661 None None] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002590 May 11 20:57:13.832800 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 3/4] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 20:57:13.889670 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e23babb3-13de-406e-8893-8575ecbf2ecc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "vcpus": 1, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:13.908126 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 20:57:13.908126 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: warnings.warn(msg) May 11 20:57:14.018484 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e23babb3-13de-406e-8893-8575ecbf2ecc admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.179874 May 11 20:57:14.019321 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 2/5] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:57:14.234182 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-e5f9e77c-57c7-4ec1-b3e1-b98c3376bbc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:14.236635 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 20:57:14.236635 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: warnings.warn(msg) May 11 20:57:14.341473 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-e5f9e77c-57c7-4ec1-b3e1-b98c3376bbc2 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313797 May 11 20:57:14.342283 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 4/6] 10.222.0.35 () {64 vars in 1335 bytes} [Wed May 11 20:57:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:57:16.613665 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e23babb3-13de-406e-8893-8575ecbf2ecc admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:16.615202 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e23babb3-13de-406e-8893-8575ecbf2ecc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 May 11 20:57:16.615609 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 3/7] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 20:57:16.720075 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-a841fccc-2a89-4f32-9342-868cdf6c3196 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "swap": 0, "disk": 5, "name": "ds512M", "id": "d1"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:16.738156 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 20:57:16.738156 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: warnings.warn(msg) May 11 20:57:16.844155 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-a841fccc-2a89-4f32-9342-868cdf6c3196 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.222032 May 11 20:57:16.850349 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 5/8] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:57:16.857487 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-c5dc1941-ae70-4366-8eec-1f08ee1a48d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:16.859767 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 20:57:16.859767 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: warnings.warn(msg) May 11 20:57:16.966875 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-c5dc1941-ae70-4366-8eec-1f08ee1a48d7 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113009 May 11 20:57:16.968594 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 4/9] 10.222.0.35 () {64 vars in 1335 bytes} [Wed May 11 20:57:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:57:19.279057 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-a841fccc-2a89-4f32-9342-868cdf6c3196 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:19.280105 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-a841fccc-2a89-4f32-9342-868cdf6c3196 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 11 20:57:19.281002 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 6/10] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:19.343090 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-773237b3-faed-42e9-9a71-58d830002a3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "swap": 0, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:19.420665 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-773237b3-faed-42e9-9a71-58d830002a3b admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133297 May 11 20:57:19.421137 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 5/11] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 20:57:19.433901 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-d15f353f-9843-4ea2-a594-9366a81ef225 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:19.509027 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-d15f353f-9843-4ea2-a594-9366a81ef225 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079226 May 11 20:57:19.510004 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 7/12] 10.222.0.35 () {64 vars in 1335 bytes} [Wed May 11 20:57:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:57:21.801967 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-773237b3-faed-42e9-9a71-58d830002a3b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:21.803029 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-773237b3-faed-42e9-9a71-58d830002a3b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 11 20:57:21.803436 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 6/13] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:21.864332 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8cba4c54-4133-4d83-808c-921620b25bd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:21.940429 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-8cba4c54-4133-4d83-808c-921620b25bd2 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131220 May 11 20:57:21.940992 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 8/14] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:57:21.952893 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-6988e305-a936-419a-95c9-7e095e40ea74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:22.069716 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-6988e305-a936-419a-95c9-7e095e40ea74 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120414 May 11 20:57:22.070317 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 7/15] 10.222.0.35 () {64 vars in 1335 bytes} [Wed May 11 20:57:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:57:24.312945 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8cba4c54-4133-4d83-808c-921620b25bd2 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:24.313983 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-8cba4c54-4133-4d83-808c-921620b25bd2 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 May 11 20:57:24.314530 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 9/16] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:24.373085 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e099de6c-922b-4a58-aaa4-2b8ad181dd95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "id": "d4", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:24.459027 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e099de6c-922b-4a58-aaa4-2b8ad181dd95 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138846 May 11 20:57:24.459704 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 8/17] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 20:57:24.473286 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-2eb2b609-7b1b-48ef-b55d-3a923c496e2d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:24.559992 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-2eb2b609-7b1b-48ef-b55d-3a923c496e2d admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091878 May 11 20:57:24.560728 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 10/18] 10.222.0.35 () {64 vars in 1335 bytes} [Wed May 11 20:57:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:57:26.806956 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e099de6c-922b-4a58-aaa4-2b8ad181dd95 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:26.807971 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e099de6c-922b-4a58-aaa4-2b8ad181dd95 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 11 20:57:26.808382 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 9/19] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:26.871167 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-bef2cf17-0b70-4b21-8b2d-bd78d9845cec admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:26.896392 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-bef2cf17-0b70-4b21-8b2d-bd78d9845cec admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081447 May 11 20:57:26.897023 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 11/20] 10.222.0.35 () {60 vars in 1291 bytes} [Wed May 11 20:57:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:57:29.165830 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e099de6c-922b-4a58-aaa4-2b8ad181dd95 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:29.166882 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e099de6c-922b-4a58-aaa4-2b8ad181dd95 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 May 11 20:57:29.167350 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 10/21] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:29.224111 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-489670bf-6662-4f63-88fd-94c54ff711fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:29.293498 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-489670bf-6662-4f63-88fd-94c54ff711fb admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.120267 May 11 20:57:29.294181 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 12/22] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:57:29.306249 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-d262f8ef-49e6-4895-8bf4-ba12ed3b0b0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:29.388753 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-d262f8ef-49e6-4895-8bf4-ba12ed3b0b0c admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085882 May 11 20:57:29.389204 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 11/23] 10.222.0.35 () {64 vars in 1332 bytes} [Wed May 11 20:57:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:57:32.278941 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-489670bf-6662-4f63-88fd-94c54ff711fb admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:32.280961 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-489670bf-6662-4f63-88fd-94c54ff711fb admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 May 11 20:57:32.281571 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 13/24] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:32.338162 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-cb7c581c-c8a6-450a-b68e-6e33ac4bb0cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 20, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true, "id": "2"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:32.453722 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-cb7c581c-c8a6-450a-b68e-6e33ac4bb0cf admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.166328 May 11 20:57:32.454226 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 12/25] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:57:32.466065 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-10fb38fa-dd74-4708-85af-f17e02623117 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:32.571443 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-10fb38fa-dd74-4708-85af-f17e02623117 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108996 May 11 20:57:32.571989 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 14/26] 10.222.0.35 () {64 vars in 1332 bytes} [Wed May 11 20:57:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 20:57:34.814338 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-cb7c581c-c8a6-450a-b68e-6e33ac4bb0cf admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:34.815358 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-cb7c581c-c8a6-450a-b68e-6e33ac4bb0cf admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 11 20:57:34.815765 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 13/27] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:34.873812 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-7bd68cc0-b8e0-4d12-b504-f15c0ac1e0d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:34.938473 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-7bd68cc0-b8e0-4d12-b504-f15c0ac1e0d9 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.116925 May 11 20:57:34.939214 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 15/28] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:57:34.950759 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0bc7c994-8aa0-4532-83ad-16638e354a5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:35.016733 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0bc7c994-8aa0-4532-83ad-16638e354a5a admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069546 May 11 20:57:35.017241 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 14/29] 10.222.0.35 () {64 vars in 1332 bytes} [Wed May 11 20:57:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 20:57:37.295206 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-7bd68cc0-b8e0-4d12-b504-f15c0ac1e0d9 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:37.296772 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-7bd68cc0-b8e0-4d12-b504-f15c0ac1e0d9 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 May 11 20:57:37.297167 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 16/30] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:37.360145 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0c3254b0-a059-4371-9b26-c801d7679bdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 80, "name": "m1.large"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:37.430924 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0c3254b0-a059-4371-9b26-c801d7679bdb admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.127812 May 11 20:57:37.431494 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 15/31] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:57:37.443845 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-0891a3b4-5b4a-4c23-9ef3-545cff3e98ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:37.549431 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-0891a3b4-5b4a-4c23-9ef3-545cff3e98ca admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109534 May 11 20:57:37.550407 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 17/32] 10.222.0.35 () {64 vars in 1332 bytes} [Wed May 11 20:57:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 20:57:39.894613 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0c3254b0-a059-4371-9b26-c801d7679bdb admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:57:39.896269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0c3254b0-a059-4371-9b26-c801d7679bdb admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 May 11 20:57:39.896670 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 16/33] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:57:39.958179 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ebf5df7e-efae-4c92-8126-5feb224af81c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "name": "m1.xlarge"}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:40.076365 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ebf5df7e-efae-4c92-8126-5feb224af81c admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.173413 May 11 20:57:40.077028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 18/34] 10.222.0.35 () {64 vars in 1282 bytes} [Wed May 11 20:57:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 20:57:40.088708 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-b40b3a19-893d-4b9e-a3fa-24d45badff8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:57:40.194643 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-b40b3a19-893d-4b9e-a3fa-24d45badff8e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109472 May 11 20:57:40.195439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 17/35] 10.222.0.35 () {64 vars in 1332 bytes} [Wed May 11 20:57:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 20:58:04.215879 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ebf5df7e-efae-4c92-8126-5feb224af81c admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:04.216920 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ebf5df7e-efae-4c92-8126-5feb224af81c admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 11 20:58:04.217346 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 19/36] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:04.274430 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-e318bddd-3516-469b-9ab2-8ef947102719 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:04.291881 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-e318bddd-3516-469b-9ab2-8ef947102719 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068693 May 11 20:58:04.292404 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 18/37] 10.222.0.35 () {60 vars in 1291 bytes} [Wed May 11 20:58:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:58:05.308617 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-ebf5df7e-efae-4c92-8126-5feb224af81c admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:05.309630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-ebf5df7e-efae-4c92-8126-5feb224af81c admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 11 20:58:05.310042 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 20/38] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:05.510019 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-dc42f0f6-291f-4687-8fd9-fe5b18dd6ee3 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:05.517195 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-dc42f0f6-291f-4687-8fd9-fe5b18dd6ee3 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-dc42f0f6-291f-4687-8fd9-fe5b18dd6ee3 admin admin] Request method failure captured: May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Accept: application/json May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Connection: keep-alive May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Content-Length: 0 May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Host: 10.222.0.35 May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABifCNdIZTup1tZaukvvCopW_llk5WVs-_zHPmi_FDeH7Uv5RLG7qbrYg0WaeblW3jvDrhJklQT8Dawe9RwcI-wkIqm3RaZ5UevH_zp94V7MgWHp9jah4W8WImsdgNet3EPxhX9hc3noPhwbw7kaLCRRLJ39VnKTdUprR2ws7i99z6zJmQ May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Domain-Id: None May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Domain-Name: None May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Name: admin May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Role: admin,member,reader May 11 20:58:05.520439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Roles: admin,member,reader May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant: admin May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User: admin May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Id: 3529d1a9e25d41d4bfc8bab9cf496381 May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Name: admin May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: method: > May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: exception: Flavor 42 could not be found. May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: action_args: {'id': '42'} May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 20:58:05.522062 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:05.523233 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:05.524416 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-dc42f0f6-291f-4687-8fd9-fe5b18dd6ee3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 20:58:05.525464 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-dc42f0f6-291f-4687-8fd9-fe5b18dd6ee3 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062294 May 11 20:58:05.525464 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 19/39] 10.222.0.35 () {60 vars in 1190 bytes} [Wed May 11 20:58:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 20:58:05.532559 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-3405d817-5800-4746-98ee-7dabaff8c3b2 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:05.554524 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-3405d817-5800-4746-98ee-7dabaff8c3b2 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026113 May 11 20:58:05.555052 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1210 bytes} [Wed May 11 20:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:58:05.564681 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-76299ad2-fa9b-4e77-801b-df37b24ea710 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:05.585255 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-76299ad2-fa9b-4e77-801b-df37b24ea710 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024214 May 11 20:58:05.585831 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 20/41] 10.222.0.35 () {60 vars in 1210 bytes} [Wed May 11 20:58:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 20:58:05.595402 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fd99513d-6494-4b7f-aba0-bbaf1f8f50d0 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:05.600767 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-fd99513d-6494-4b7f-aba0-bbaf1f8f50d0 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fd99513d-6494-4b7f-aba0-bbaf1f8f50d0 admin admin] Request method failure captured: May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Accept: application/json May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Connection: keep-alive May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Content-Length: 0 May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Host: 10.222.0.35 May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABifCNdIZTup1tZaukvvCopW_llk5WVs-_zHPmi_FDeH7Uv5RLG7qbrYg0WaeblW3jvDrhJklQT8Dawe9RwcI-wkIqm3RaZ5UevH_zp94V7MgWHp9jah4W8WImsdgNet3EPxhX9hc3noPhwbw7kaLCRRLJ39VnKTdUprR2ws7i99z6zJmQ May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Domain-Id: None May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Domain-Name: None May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Name: admin May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Role: admin,member,reader May 11 20:58:05.604032 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Roles: admin,member,reader May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant: admin May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User: admin May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Id: 3529d1a9e25d41d4bfc8bab9cf496381 May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Name: admin May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: method: > May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: exception: Flavor 42 could not be found. May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: action_args: {'id': '42'} May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 20:58:05.605656 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:05.606827 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:05.608621 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-fd99513d-6494-4b7f-aba0-bbaf1f8f50d0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 20:58:05.610147 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-fd99513d-6494-4b7f-aba0-bbaf1f8f50d0 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014117 May 11 20:58:05.610147 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 22/42] 10.222.0.35 () {60 vars in 1190 bytes} [Wed May 11 20:58:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 20:58:06.478804 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-76299ad2-fa9b-4e77-801b-df37b24ea710 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:06.479815 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-76299ad2-fa9b-4e77-801b-df37b24ea710 admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 11 20:58:06.480214 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 21/43] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:06.673501 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8ae3de17-423b-4db4-a3bc-d41935966869 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:06.678815 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-8ae3de17-423b-4db4-a3bc-d41935966869 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8ae3de17-423b-4db4-a3bc-d41935966869 admin admin] Request method failure captured: May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Accept: application/json May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Connection: keep-alive May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Content-Length: 0 May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Host: 10.222.0.35 May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABifCNe9kS2Mcxs3D_j12l9ScVfocvUN_eCFR1O1k254uPdsn2rPFcPRJgZIu_fv6Bv274nGpxPbmRWopVBpt8XlQlJBHWF0QEody1ot0bySnCyqoEvT6ndFbROwDmYXoB5xH7rXrDbFgYRB-SPongZcGFSgsxFYdUrwGsMBJS4tWP6Mv4 May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Domain-Id: None May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Domain-Name: None May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Name: admin May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Role: admin,member,reader May 11 20:58:06.680399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Roles: admin,member,reader May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant: admin May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User: admin May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Id: 3529d1a9e25d41d4bfc8bab9cf496381 May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Name: admin May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: method: > May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: exception: Flavor 84 could not be found. May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: action_args: {'id': '84'} May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 20:58:06.681977 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:06.683028 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:06.684395 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8ae3de17-423b-4db4-a3bc-d41935966869 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 20:58:06.685684 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-8ae3de17-423b-4db4-a3bc-d41935966869 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059985 May 11 20:58:06.685684 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 23/44] 10.222.0.35 () {60 vars in 1190 bytes} [Wed May 11 20:58:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 11 20:58:06.692002 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-4ef2ad6a-d581-473e-8745-bec4077c3246 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:06.705096 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-4ef2ad6a-d581-473e-8745-bec4077c3246 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016713 May 11 20:58:06.705702 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 22/45] 10.222.0.35 () {60 vars in 1210 bytes} [Wed May 11 20:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:58:06.714516 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-3d8d3b55-f489-42a6-bf25-33ff0ab445bc admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:06.727757 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-3d8d3b55-f489-42a6-bf25-33ff0ab445bc admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016692 May 11 20:58:06.728319 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 24/46] 10.222.0.35 () {60 vars in 1210 bytes} [Wed May 11 20:58:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:58:06.737793 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ca0cb5a9-08ca-4c87-bd2c-2d779f4653cb admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:06.742928 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-ca0cb5a9-08ca-4c87-bd2c-2d779f4653cb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ca0cb5a9-08ca-4c87-bd2c-2d779f4653cb admin admin] Request method failure captured: May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Accept: application/json May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Connection: keep-alive May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Content-Length: 0 May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Host: 10.222.0.35 May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABifCNe9kS2Mcxs3D_j12l9ScVfocvUN_eCFR1O1k254uPdsn2rPFcPRJgZIu_fv6Bv274nGpxPbmRWopVBpt8XlQlJBHWF0QEody1ot0bySnCyqoEvT6ndFbROwDmYXoB5xH7rXrDbFgYRB-SPongZcGFSgsxFYdUrwGsMBJS4tWP6Mv4 May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Domain-Id: None May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Domain-Name: None May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Name: admin May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Role: admin,member,reader May 11 20:58:06.744420 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Roles: admin,member,reader May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant: admin May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User: admin May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Id: 3529d1a9e25d41d4bfc8bab9cf496381 May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Name: admin May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: method: > May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: exception: Flavor 84 could not be found. May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: action_args: {'id': '84'} May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 20:58:06.745962 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:06.747061 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:06.748968 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-ca0cb5a9-08ca-4c87-bd2c-2d779f4653cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 20:58:06.750300 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-ca0cb5a9-08ca-4c87-bd2c-2d779f4653cb admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011463 May 11 20:58:06.750300 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 23/47] 10.222.0.35 () {60 vars in 1190 bytes} [Wed May 11 20:58:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 20:58:07.622584 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-3d8d3b55-f489-42a6-bf25-33ff0ab445bc admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:07.623799 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-3d8d3b55-f489-42a6-bf25-33ff0ab445bc admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 May 11 20:58:07.624198 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 25/48] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:07.812757 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-9c02c39b-5344-4529-a7c8-3b1c9b4af791 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:07.818404 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.wsgi [None req-9c02c39b-5344-4529-a7c8-3b1c9b4af791 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-9c02c39b-5344-4529-a7c8-3b1c9b4af791 admin admin] Request method failure captured: May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Accept: application/json May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Accept-Encoding: gzip, deflate May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Connection: keep-alive May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Content-Length: 0 May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Host: 10.222.0.35 May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Openstack-Api-Version: compute 2.90 May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Openstack-System-Scope: None May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: User-Agent: python-novaclient May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Auth-Token: gAAAAABifCNfQuCIHHpjH5YroH6e-aBFh77F-AtyMp4IWQ6sU4xy35ohVT5eNoXVIST2slmJ9FJp7XAjrLxg4UKbPjyIw2UgDUvWFuRFLiXTkUN9r40PDJfyxZUsS8_hoK_HPz-wgQdYcfgMFsJfLprPrrh8ykOMGZhypVNsiYgXL2Zu1XEcrvE May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Domain-Id: None May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Domain-Name: None May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Identity-Status: Confirmed May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Is-Admin-Project: True May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Openstack-Nova-Api-Version: 2.90 May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Domain-Id: default May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Domain-Name: Default May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Project-Name: admin May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Role: admin,member,reader May 11 20:58:07.819909 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Roles: admin,member,reader May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant: admin May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-Tenant-Name: admin May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User: admin May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Domain-Id: default May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Domain-Name: Default May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Id: 3529d1a9e25d41d4bfc8bab9cf496381 May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: X-User-Name: admin May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: method: > May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: exception: Flavor 451 could not be found. May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: action_args: {'id': '451'} May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 20:58:07.821356 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:07.822269 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: ERROR nova.api.openstack.wsgi May 11 20:58:07.823623 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-9c02c39b-5344-4529-a7c8-3b1c9b4af791 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103265) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 20:58:07.825030 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-9c02c39b-5344-4529-a7c8-3b1c9b4af791 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063604 May 11 20:58:07.825030 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 24/49] 10.222.0.35 () {60 vars in 1193 bytes} [Wed May 11 20:58:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 20:58:07.831555 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-85199fd6-a394-4cd3-9072-d3cae9f03f5a admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:07.844959 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-85199fd6-a394-4cd3-9072-d3cae9f03f5a admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016994 May 11 20:58:07.845492 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 26/50] 10.222.0.35 () {60 vars in 1210 bytes} [Wed May 11 20:58:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 20:58:07.854838 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:07.868176 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] 10.222.0.35 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016937 May 11 20:58:07.868727 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 25/51] 10.222.0.35 () {60 vars in 1210 bytes} [Wed May 11 20:58:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:58:07.878270 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-53c80193-b2af-4be7-a010-53305f94f9f4 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:07.883422 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.wsgi [None req-53c80193-b2af-4be7-a010-53305f94f9f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-53c80193-b2af-4be7-a010-53305f94f9f4 admin admin] Request method failure captured: May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Accept: application/json May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Accept-Encoding: gzip, deflate May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Connection: keep-alive May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Content-Length: 0 May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Host: 10.222.0.35 May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Openstack-Api-Version: compute 2.90 May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Openstack-System-Scope: None May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: User-Agent: python-novaclient May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Auth-Token: gAAAAABifCNfQuCIHHpjH5YroH6e-aBFh77F-AtyMp4IWQ6sU4xy35ohVT5eNoXVIST2slmJ9FJp7XAjrLxg4UKbPjyIw2UgDUvWFuRFLiXTkUN9r40PDJfyxZUsS8_hoK_HPz-wgQdYcfgMFsJfLprPrrh8ykOMGZhypVNsiYgXL2Zu1XEcrvE May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Domain-Id: None May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Domain-Name: None May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Identity-Status: Confirmed May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Is-Admin-Project: True May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Openstack-Nova-Api-Version: 2.90 May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Domain-Id: default May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Domain-Name: Default May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Project-Name: admin May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Role: admin,member,reader May 11 20:58:07.884892 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Roles: admin,member,reader May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/2831911a3b2e4e6f87ef9844395d784e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant: admin May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant-Id: 2831911a3b2e4e6f87ef9844395d784e May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-Tenant-Name: admin May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User: admin May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Domain-Id: default May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Domain-Name: Default May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Id: 3529d1a9e25d41d4bfc8bab9cf496381 May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: X-User-Name: admin May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: method: > May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: exception: Flavor 451 could not be found. May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: action_args: {'id': '451'} May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 20:58:07.886525 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:07.887669 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: ERROR nova.api.openstack.wsgi May 11 20:58:07.889630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-53c80193-b2af-4be7-a010-53305f94f9f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103264) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 20:58:07.890897 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-53c80193-b2af-4be7-a010-53305f94f9f4 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011448 May 11 20:58:07.890897 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 27/52] 10.222.0.35 () {60 vars in 1193 bytes} [Wed May 11 20:58:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 20:58:08.768029 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:08.769023 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 11 20:58:08.769417 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 26/53] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:08.957275 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-f4451556-24ab-425c-b45a-376cade25c41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:58:09.075018 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-f4451556-24ab-425c-b45a-376cade25c41 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.168410 May 11 20:58:09.075551 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 28/54] 10.222.0.35 () {64 vars in 1235 bytes} [Wed May 11 20:58:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:58:09.956276 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:09.957278 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 11 20:58:09.957714 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:10.144577 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-be319f9c-b346-4198-afbb-07539d81fa2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:58:10.251919 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-be319f9c-b346-4198-afbb-07539d81fa2e admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.157043 May 11 20:58:10.252456 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 29/56] 10.222.0.35 () {64 vars in 1235 bytes} [Wed May 11 20:58:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:58:11.131037 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:11.132044 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 11 20:58:11.132439 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 28/57] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:11.319886 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-6d63508d-468f-4bf8-a346-d8da2bb76919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:58:11.388671 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-6d63508d-468f-4bf8-a346-d8da2bb76919 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.119171 May 11 20:58:11.389117 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 30/58] 10.222.0.35 () {64 vars in 1235 bytes} [Wed May 11 20:58:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 20:58:12.268994 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:12.270050 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 11 20:58:12.270457 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 29/59] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:12.458351 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-1d6b3541-dd52-4dc6-8f53-e07faeb49b10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 20:58:12.554895 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-1d6b3541-dd52-4dc6-8f53-e07faeb49b10 admin admin] 10.222.0.35 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.148237 May 11 20:58:12.555429 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 31/60] 10.222.0.35 () {64 vars in 1235 bytes} [Wed May 11 20:58:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 20:58:13.433012 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:13.434069 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 11 20:58:13.434465 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 30/61] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 20:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:58:13.619565 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-4de1c1e1-f6e9-409b-8171-e0188a1723d0 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:58:13.639763 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-4de1c1e1-f6e9-409b-8171-e0188a1723d0 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070637 May 11 20:58:13.640305 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 32/62] 10.222.0.35 () {60 vars in 1202 bytes} [Wed May 11 20:58:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:59:15.440743 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:59:15.441788 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-0a949c00-fdd7-45db-8e5b-e0288101954b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 11 20:59:15.442189 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 31/63] 10.222.0.35 () {54 vars in 930 bytes} [Wed May 11 20:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 20:59:15.498575 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-9f2e2747-a791-4d4b-b65a-b6cb0f907f48 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:59:15.517778 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-9f2e2747-a791-4d4b-b65a-b6cb0f907f48 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069789 May 11 20:59:15.518307 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 33/64] 10.222.0.35 () {60 vars in 1291 bytes} [Wed May 11 20:59:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 20:59:15.540829 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-a2d3b8ba-da39-48c4-a2a4-c0763d85d5e6 admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:59:15.548334 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-a2d3b8ba-da39-48c4-a2a4-c0763d85d5e6 admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011727 May 11 20:59:15.548842 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 32/65] 10.222.0.35 () {60 vars in 1282 bytes} [Wed May 11 20:59:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:59:15.560036 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-8152e044-5a27-4bd2-9b0b-8531d3229efa admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:59:15.567434 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-8152e044-5a27-4bd2-9b0b-8531d3229efa admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011431 May 11 20:59:15.567935 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 34/66] 10.222.0.35 () {60 vars in 1285 bytes} [Wed May 11 20:59:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:59:15.579122 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:59:15.586321 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010593 May 11 20:59:15.586830 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 33/67] 10.222.0.35 () {60 vars in 1285 bytes} [Wed May 11 20:59:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 20:59:15.597193 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-52a1d347-01e0-4a1c-aae2-ba7173acb20c admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 20:59:15.604382 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-52a1d347-01e0-4a1c-aae2-ba7173acb20c admin admin] 10.222.0.35 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010533 May 11 20:59:15.604879 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 35/68] 10.222.0.35 () {60 vars in 1282 bytes} [Wed May 11 20:59:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:02:42.839123 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:42.840170 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 11 21:02:42.840564 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 34/69] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 21:02:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:02:43.106630 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-793f020f-b17d-482c-adf3-1a949a5d35fb admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:43.107785 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:02:43.107785 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: warnings.warn(msg) May 11 21:02:43.109010 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-793f020f-b17d-482c-adf3-1a949a5d35fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:43.109454 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-793f020f-b17d-482c-adf3-1a949a5d35fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:43.110256 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-793f020f-b17d-482c-adf3-1a949a5d35fb admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:43.110679 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-793f020f-b17d-482c-adf3-1a949a5d35fb admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:43.143317 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-793f020f-b17d-482c-adf3-1a949a5d35fb admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147206 May 11 21:02:43.143866 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 36/70] 10.222.0.35 () {60 vars in 1193 bytes} [Wed May 11 21:02:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 21:02:44.040462 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:44.041474 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 11 21:02:44.041943 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 35/71] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 21:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:02:44.227740 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-0a5420a9-e638-44b4-8986-e2b693426e56 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:44.228912 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:02:44.228912 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: warnings.warn(msg) May 11 21:02:44.230132 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-0a5420a9-e638-44b4-8986-e2b693426e56 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:44.230607 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-0a5420a9-e638-44b4-8986-e2b693426e56 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:44.231399 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-0a5420a9-e638-44b4-8986-e2b693426e56 admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:44.231829 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-0a5420a9-e638-44b4-8986-e2b693426e56 admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:44.250912 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-0a5420a9-e638-44b4-8986-e2b693426e56 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.071329 May 11 21:02:44.251387 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 37/72] 10.222.0.35 () {60 vars in 1193 bytes} [Wed May 11 21:02:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 21:02:55.551795 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:55.552868 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 11 21:02:55.553267 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 36/73] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 21:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:02:55.741720 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-20748eae-c3fb-4cdc-81e7-ed9f02f3fd12 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:55.742883 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:02:55.742883 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: warnings.warn(msg) May 11 21:02:55.744086 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-20748eae-c3fb-4cdc-81e7-ed9f02f3fd12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:55.744521 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-20748eae-c3fb-4cdc-81e7-ed9f02f3fd12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:55.745299 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-20748eae-c3fb-4cdc-81e7-ed9f02f3fd12 admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:55.746339 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-20748eae-c3fb-4cdc-81e7-ed9f02f3fd12 admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:55.769817 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-20748eae-c3fb-4cdc-81e7-ed9f02f3fd12 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078278 May 11 21:02:55.770351 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 38/74] 10.222.0.35 () {60 vars in 1193 bytes} [Wed May 11 21:02:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:02:56.656482 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: DEBUG nova.api.openstack.wsgi [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] Calling method '>' {{(pid=103265) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:56.657480 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: INFO nova.api.openstack.requestlog [None req-55658399-6b5d-47a1-be1a-0d6b92e9f92b admin admin] 10.222.0.35 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 11 21:02:56.657976 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: [pid: 103265|app: 0|req: 37/75] 10.222.0.35 () {56 vars in 1074 bytes} [Wed May 11 21:02:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:02:56.846608 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG nova.api.openstack.wsgi [None req-5aedd894-6496-4dfc-a886-2f99ca1dca48 admin admin] Calling method '>' {{(pid=103264) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:02:56.847775 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:02:56.847775 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: warnings.warn(msg) May 11 21:02:56.849035 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-5aedd894-6496-4dfc-a886-2f99ca1dca48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:56.849426 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-5aedd894-6496-4dfc-a886-2f99ca1dca48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:56.850240 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-5aedd894-6496-4dfc-a886-2f99ca1dca48 admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:02:56.850668 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: DEBUG oslo_concurrency.lockutils [None req-5aedd894-6496-4dfc-a886-2f99ca1dca48 admin admin] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103264) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:02:56.872944 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: INFO nova.api.openstack.requestlog [None req-5aedd894-6496-4dfc-a886-2f99ca1dca48 admin admin] 10.222.0.35 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077290 May 11 21:02:56.873424 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: [pid: 103264|app: 0|req: 39/76] 10.222.0.35 () {60 vars in 1193 bytes} [Wed May 11 21:02:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:03:55.170238 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: Wed May 11 21:03:55 2022 - graceful shutdown triggered... May 11 21:03:55.169723 dv-cinder-841467-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 11 21:03:55.171263 dv-cinder-841467-1-iscsi devstack@n-api.service[103264]: Gracefully killing worker 1 (pid: 103264)... May 11 21:03:55.171635 dv-cinder-841467-1-iscsi devstack@n-api.service[103265]: Gracefully killing worker 2 (pid: 103265)... May 11 21:03:56.170779 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: worker 1 buried after 1 seconds May 11 21:03:56.170779 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: worker 2 buried after 1 seconds May 11 21:03:56.170779 dv-cinder-841467-1-iscsi devstack@n-api.service[103263]: goodbye to uWSGI. May 11 21:03:56.172272 dv-cinder-841467-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 11 21:03:56.172847 dv-cinder-841467-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 11 21:03:56.175620 dv-cinder-841467-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 21:03:56.192844 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 21:03:56 2022] *** May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: nodename: dv-cinder-841467-1-iscsi May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: machine: x86_64 May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: clock source: unix May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: pcre jit disabled May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: detected number of CPU cores: 4 May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: current working directory: / May 11 21:03:56.208248 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: detected binary path: /usr/bin/uwsgi-core May 11 21:03:56.209051 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: your processes number limit is 47680 May 11 21:03:56.209051 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: your memory page size is 4096 bytes May 11 21:03:56.209051 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: detected max file descriptor number: 2048 May 11 21:03:56.209051 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: lock engine: pthread robust mutexes May 11 21:03:56.209051 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: thunder lock: enabled May 11 21:03:56.209051 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 21:03:56.209051 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 21:03:56.256209 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: Python main interpreter initialized at 0x5618325ac9c0 May 11 21:03:56.256209 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: python threads support enabled May 11 21:03:56.256209 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: your server socket listen backlog is limited to 100 connections May 11 21:03:56.256209 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: your mercy for graceful operations on workers is 90 seconds May 11 21:03:56.256674 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: mapped 403077 bytes (393 KB) for 2 cores May 11 21:03:56.256674 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: *** Operational MODE: preforking *** May 11 21:03:56.256916 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: *** uWSGI is running in multiple interpreter mode *** May 11 21:03:56.256916 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: spawned uWSGI master process (pid: 117592) May 11 21:03:56.257124 dv-cinder-841467-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 21:03:56.257721 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: spawned uWSGI worker 1 (pid: 117611, cores: 1) May 11 21:03:56.258557 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: spawned uWSGI worker 2 (pid: 117612, cores: 1) May 11 21:03:56.258557 dv-cinder-841467-1-iscsi devstack@n-api.service[117592]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 21:03:57.464221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 21:03:57.482687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 21:03:58.262907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 21:03:58.262907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: from cryptography.utils import int_from_bytes May 11 21:03:58.263232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 21:03:58.263232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: from cryptography.utils import int_from_bytes May 11 21:03:58.288122 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 21:03:58.288122 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: from cryptography.utils import int_from_bytes May 11 21:03:58.288364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 21:03:58.288364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: from cryptography.utils import int_from_bytes May 11 21:04:00.692257 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 21:04:00.692820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 21:04:00.693115 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 21:04:00.693692 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 21:04:00.694036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 21:04:00.694425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.694764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.695099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.695620 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.695970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.696326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.696727 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.697063 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.697413 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.697717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.698046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.698382 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841467-1-iscsi {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.698719 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.699036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.699359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.699685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.699998 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.700331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.700648 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.701161 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.701672 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.701952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.702270 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.704722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.704722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.704722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.704722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.704722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.704722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.704722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.705890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841467-1-iscsi {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.705890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.706122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.706883 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.707096 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.707463 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.707789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.708145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.708665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.709050 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.709393 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.709748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.710077 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.710407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.710718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.711039 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.711359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.711683 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.711995 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.712306 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.712563 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.712884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.713209 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.713552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.713882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.714162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.714420 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.714748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.715074 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.715391 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.715708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.716026 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.716341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.716659 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.716973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.717288 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.717624 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.717951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.718275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.718604 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.718923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.719250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.719657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.719915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.720231 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.720621 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.720946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.721261 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.721612 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.721945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.722262 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.722575 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.722890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.723216 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.723548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.723860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.724116 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.724425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.724739 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.725064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.725377 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.725718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.726033 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.726345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.726662 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.726978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.727373 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.727602 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.727920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.728232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.728571 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.728890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.729257 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.729544 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.729958 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.730182 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.730497 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.730845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.731166 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.731483 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.731799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.732112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.732443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.732758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.733072 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.733403 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.733724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.734042 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.734364 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.734674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.734989 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.735296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.735614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.735973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.736287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.736604 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.736927 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.737241 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.737571 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.737920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.743267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.743962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.744591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.744591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.744591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.744591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.744591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.745037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.745158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.745270 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 21:04:00.745749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 21:04:00.745849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.745849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.746025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 21:04:00.746114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.746323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 21:04:00.746421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.746602 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 21:04:00.746746 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.746973 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.747114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.747304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.747414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.747631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.747738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.747957 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.748082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.748300 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.748498 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.748641 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.748738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.748965 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.749074 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.749291 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.749385 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.749651 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.749762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.749919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.750049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.750238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.750333 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.750566 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841467-1-iscsi {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.750670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.750957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.751125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.751277 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.751421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.752121 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.752349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.752473 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.752734 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.752845 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.753053 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.753157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.753374 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.753491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.753716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.753876 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.754080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.754226 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.754402 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.754545 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.754697 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.754845 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.755021 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.755166 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.755344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.755448 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.755663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.755769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.755981 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.756088 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.756299 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.756395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.756608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.756706 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.756919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.757121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.757212 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.757304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.757557 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.757710 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841467-1-iscsi {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.757860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.758029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.758186 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.758352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.758536 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.758692 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.758853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.759076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.759245 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.759397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.759554 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.759792 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.759964 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.760122 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.760273 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.760442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.760592 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.760750 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.760908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.761066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.761278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.761459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.761647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.761844 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.761999 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.762159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.762309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.762563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.762820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.762989 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.763148 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.763335 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.763493 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.763642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.763790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.763948 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.764106 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.764263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.764455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.764574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.764706 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.764832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.764954 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.765070 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.765345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.765479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.773808 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.773928 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.774021 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.774126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.774222 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.774357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.774463 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.774552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.774651 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.774739 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.774739 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.774903 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.774997 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.775084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.775168 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.775252 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.775344 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.775440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.775534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.775621 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.775706 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.775790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.775873 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.775972 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.776073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.776167 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.776254 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.776353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.776450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.776538 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.776631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.776725 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.776811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.776904 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.777005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.777092 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.777092 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.777269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.35 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.777364 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.777467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.35 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.777592 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.777699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.777787 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.777872 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.777965 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.778052 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.778137 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.778252 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.778347 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.778435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.778644 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.778753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.778849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.778947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.779034 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.779119 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.779211 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.779300 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.779394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.779494 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.779589 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.779719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.779806 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.779900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.779900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.780109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.780198 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.780283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.780363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.780919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.781028 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.781118 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.781212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.781298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.781393 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.781496 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.781723 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.781827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.781915 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.782000 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.782092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.782178 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.782282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.782408 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.782521 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.782617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.782700 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.782778 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.782894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.782994 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.783076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.783162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.783249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.783348 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.783435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.783539 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.783636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.783723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.783816 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.783913 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.784000 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.784091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.784177 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.784177 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.784340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.784436 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.784529 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.784624 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.784723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.784818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.784904 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.784997 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.785083 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.785168 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.785435 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.785549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.785635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.785709 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.785792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.785891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.785987 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.786082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.786177 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.786271 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.786358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.786452 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.786547 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.786634 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.786719 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.786811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.786897 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.786992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.787073 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.787159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.787246 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.787339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.787425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.787515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.787604 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.787698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.787784 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.787876 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.787969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.788069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.788164 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.788259 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.788394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.788716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.788822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.788905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.788998 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.789093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.789188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.789276 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.789433 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.789587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.789792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.789898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.790091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.790236 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.790406 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.790516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.790723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.790836 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 21:04:00.791046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.791157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.791357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.791458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.791666 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.791819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.791973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.792082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.792291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.792384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.792617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.792715 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.792934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.793039 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.793253 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.793354 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.793596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.793706 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.793928 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.794037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.794245 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.794339 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.794560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.794663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.794875 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.794971 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.795198 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.795292 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.795510 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.795611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.795820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.795915 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.796147 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.796247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.796468 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.796576 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.796814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.796915 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.797137 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.797245 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.797461 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.797582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.797802 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.797920 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.798121 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.798205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.798456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.798622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.798801 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.798952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.799102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.799269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.799450 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.799623 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.799767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.799899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.800097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.800244 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.800417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.800570 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.800721 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.800856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.801037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.801132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.801361 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.801463 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.801698 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.801807 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.802012 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.802118 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.802331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.802426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.802657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.802757 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.802970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.803075 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.803295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.803438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.803696 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.803881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.804015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.804219 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.804357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.804541 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.804678 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.804884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.804979 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.805213 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.805321 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.805561 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.805659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.805903 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.806010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.806237 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.806341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.806553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.806647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.806859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.806981 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.807167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.807270 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.807476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.807578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.807785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.807916 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.808088 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.808181 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.808404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.808507 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.808716 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.808820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.809025 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.809135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.809339 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.809445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.809675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.809782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.810005 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.810120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.810319 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.810453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.810631 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.810738 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.810941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.811042 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.811260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.811432 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.811575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.811679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.811880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.811974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.812202 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.812312 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.812515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.812618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.812823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.812916 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.813133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.813236 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.813440 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.813609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.813774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.813870 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.814642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.814786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.814969 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.815090 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.815288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.815417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.815606 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.815728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.815921 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.816018 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.816235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.816328 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.816549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.816682 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.816867 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.816970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.817181 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.817290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.817491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.817620 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.817848 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.817959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.818139 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.818249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.818449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.818551 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.818770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.818905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.819076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.819206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.819392 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.819520 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.819699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.819818 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.820008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.820142 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.820313 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.820440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.820620 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.820738 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.820923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.821043 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.821232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.821351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.821552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.821673 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.821867 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.821989 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.822171 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.822299 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.822493 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.822645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.822807 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.822926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.823095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.823225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.823403 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.823532 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.823717 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.823850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.824014 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.824142 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.824322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.824458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.824632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.824817 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.824946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.825060 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.825248 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.825385 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.825575 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.825688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.825908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.826010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.826225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.826329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.826533 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.826627 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.826856 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.826953 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.827164 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.827315 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.827481 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.827584 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.827806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.827939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.828122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.828224 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.828447 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.828542 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.828764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.828866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.829070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.829173 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.829384 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.829486 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.829791 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831480 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831578 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831752 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.831938 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832032 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832032 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832198 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832381 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832648 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.832878 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.833088 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.833199 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.833402 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.833554 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.833734 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.833839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.834045 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.834151 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.834354 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.834466 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.834669 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.834767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.834992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.835089 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.835307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.835409 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.835637 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.835764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.835952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.836058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.836272 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.836380 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.836576 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.836679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.836892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.836989 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.837209 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.837333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.837599 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.837719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.837883 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.837988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.838198 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.838314 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.838524 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.838627 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.838838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.838934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.839150 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.839274 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.839471 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.839580 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.839786 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.839891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.840098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.840210 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.840408 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.840549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.840738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.841026 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.841130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.841346 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.841456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.841691 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.841801 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.842005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.842115 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.842320 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.842425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.842626 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.842753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.842963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.843258 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.843363 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.843830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.843946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.844037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.844116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.844233 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.844324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845093 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845093 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845346 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845681 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.845886 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.846005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.846140 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.846322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.846459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.846559 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.846761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.846870 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.847068 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.847173 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.847376 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.847479 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.847693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.847790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.848005 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.848112 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.848317 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.848458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.848638 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.848818 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.849016 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.849130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.849312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.849410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.849657 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.849758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.849973 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.850070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.850285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.850388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.850608 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.850704 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.850926 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.851024 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.851240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.851409 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.851557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.851728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.851872 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.852033 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.852185 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.852352 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.852500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.852662 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.852825 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.853018 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.853132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.853282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.853428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.853636 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.853783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.853945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.854078 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.854246 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.854390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.854553 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.854711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.854882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.855192 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.855328 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.855541 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.855645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.855937 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.856080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.856266 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.856388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.856593 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.856696 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.856918 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.857014 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.857255 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.857358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.857614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.857714 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.859767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.859924 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.859924 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860203 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860308 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.860976 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861077 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861173 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861260 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861346 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861426 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861499 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861605 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861683 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861755 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861826 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861897 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.861985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862067 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862142 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862390 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.862909 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.863144 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.863246 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.863465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.863570 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.863794 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.863890 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.864102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.864217 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.864405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.864511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.864712 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.864815 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.865027 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.865130 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.865339 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.865444 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.865675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.865772 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.866006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.866100 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.866338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.866434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.866660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.866754 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.866978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.867074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.867294 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.867390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.867603 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.867699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.867910 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.868062 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.868218 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.868322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.868534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.868632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.868846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.868951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.869157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.869253 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.869471 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.869586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.869826 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.869939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.870132 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.870233 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.870444 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.870538 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.870752 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.870863 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.871060 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.871163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.871394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.871497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.871706 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.871811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.872033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.872134 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.872340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.872441 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.872647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.872744 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.872961 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.873057 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.873273 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.873377 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.873602 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.873702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.873917 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.874011 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.874218 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.874325 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.874533 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.874630 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.874838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.874978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.875145 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.875250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.875453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.875548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.875764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.875868 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.876076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.876187 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.876381 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.876486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.877222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.877318 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.877578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.877695 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.877899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.877994 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.878206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.878318 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.878513 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.878618 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.878820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.878959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.879127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.879223 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.879439 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.879535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.879761 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.879856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.880075 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.880171 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.880378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.880481 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.880683 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.880777 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.880987 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.881079 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.881293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.881389 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.881647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.881784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.881987 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.882098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.882290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.882393 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.882598 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.882694 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.882904 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.883014 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.883208 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.883317 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.883512 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.883610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.883833 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.883938 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.884146 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.884302 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.884516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.884628 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.884748 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.884853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.885055 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.885158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.885398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.885508 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.885731 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.885831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.886061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.886163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.886384 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.886487 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.886699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.886793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.887018 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.887116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.887331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.887573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.887670 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.887907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.888010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.888230 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.888326 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.888548 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.888676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.888865 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.889009 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.889183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.889286 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.889491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.889629 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.889827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.889930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.890140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.890248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.890456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.890559 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.890768 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.890871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.891092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.891200 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.891418 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.891521 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.891745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.891847 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.892052 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.892175 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.892908 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.893007 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.893227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.893330 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.893555 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.893666 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.893878 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.893974 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.894192 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.894292 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.894566 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.894691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.894821 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.894916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.895138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.895247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.895456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.895560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.895771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.895866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.896080 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.896186 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.896394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.896789 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.896967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.897062 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.897274 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.897417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.897625 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.897726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.897944 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.898038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.898251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.898355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.898565 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.898660 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.898872 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.898968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.899187 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.899283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.899494 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.899597 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.899840 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.899935 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.900160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.900256 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.900482 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.900578 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.900846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.901009 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.901165 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.901327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.901479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.901688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.901827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.902019 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.902144 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.902371 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.902474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.902692 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.902856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.903034 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.903171 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.903331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.903486 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.903641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.903801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.903952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.904107 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.904268 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.904413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905520 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905659 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905757 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.905949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.906038 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.906132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.906227 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.906323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.906440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.906545 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.906857 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.907007 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.907277 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.907380 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.907592 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.907733 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.907925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.908030 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.908302 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.908441 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.908625 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.908738 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.908943 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.909038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.909265 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.909358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.909593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.909703 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.909906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.910010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.910225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.910321 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.910541 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.910644 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.910851 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.910998 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.911162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.911273 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.911478 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.911581 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.911790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.911892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.912096 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.912190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.912403 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.912498 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.912708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.912802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.913041 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.913147 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.913366 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.913461 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.913770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.913876 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.914081 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.914191 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.914399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.914503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.914708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.914813 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.915041 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.915190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.915358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.915494 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.915668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.915774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.915980 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.916084 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.916288 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.916383 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.916601 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.916698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.916910 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.917007 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.917226 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.917320 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.917554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.917650 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.917866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.917962 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.918179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.918273 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.918492 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.918589 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.918800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.918911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.919108 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.919202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.919431 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.919540 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.919745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.919855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.920069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.920165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.920387 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.920497 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.920703 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.920806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.921023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.921116 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.921330 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.921436 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.921677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.921913 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.922011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.922260 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.922363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.922583 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.922685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.922891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.922993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.923237 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.923341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.923568 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.923666 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.923880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.923982 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.924196 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.924304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.924526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.924630 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.924839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.924943 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.925175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.925285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.925492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.925618 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.925830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.925927 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.926147 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.926256 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.926462 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.926557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.926766 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.926861 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.927072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.927221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.927385 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.927481 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.927693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.927789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.928000 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.928148 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.928307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.928411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.928618 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.928713 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.928922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.929029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.929226 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.929320 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.929550 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.929648 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.929880 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.929978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.930185 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.930290 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.930508 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.930664 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.930819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.930915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.931125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.931228 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.931431 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.931545 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.931737 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.931833 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.932080 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.932175 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.932386 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.932565 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.932717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.932811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.933033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.933127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.933355 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.933459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.933716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.933815 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.934030 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.934124 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.934355 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.934460 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.934676 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.934779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.934994 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.935097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.935312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.935420 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.935627 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.935724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.935943 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.936046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.936261 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.936357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.936577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.936672 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.936889 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.936994 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.937208 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.937342 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.937541 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.937657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.937864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.937973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.938192 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.938395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.938492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.938727 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.938822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.939607 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.939748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.939875 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.939970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.940197 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.940301 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.940514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.940619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.940831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.940934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.941139 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.941242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.941448 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.941571 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.941782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.941877 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.942095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.942201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.942402 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.942497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.942713 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.942810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.943046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.943152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.943357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.943462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.943666 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.943809 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.943975 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.944072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.944290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.944375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.944598 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.944691 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.944907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.945041 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.945215 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.945324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.945539 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.945650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.945849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.945948 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.946181 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.946275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.946500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.946608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.946816 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.946911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.947130 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.947225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.947445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.947553 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.947759 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.947862 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.948071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.948212 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.948383 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.948491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.948698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.948793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.949012 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.949117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.949334 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.949438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.949693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.949828 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.950012 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.950126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.950329 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.950426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.950643 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.950773 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.950959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.951081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.951275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.951479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.951583 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.951796 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.951912 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.952129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.952247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.952455 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.952551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.952780 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.952876 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.953098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.953195 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.953414 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.953516 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.953765 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.953872 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.954074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.954177 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.954380 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.954478 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.954732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.955365 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.955556 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.955676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.955861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.956008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.956328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.956445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.956650 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.956764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.956954 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.957065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.957280 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.957432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.957619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.957728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.957960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.958160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.958306 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.958512 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.958679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.958828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.958967 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.959157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.959267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.959485 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.959617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.959809 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.959956 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.960123 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.960275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.960448 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.960594 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.960755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.960905 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.961064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.961173 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 21:04:00.961379 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.961717 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.962024 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.962331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.962644 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.962955 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.963260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.963573 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.963878 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.964207 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.964515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.964820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.965123 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.965437 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.965769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.966072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.966377 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.966679 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.966988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.967290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.967601 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.967905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.968216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.968520 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.968829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.969190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.969514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.969842 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.970152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.970493 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.970806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.971132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.971446 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.971758 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.972106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.972425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.972965 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.973304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.973648 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.973984 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.974319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.974628 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.974934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.975244 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.975570 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.975884 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.976197 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.976509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.976819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.977131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.977443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.978131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.978131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.978382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.978693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.979003 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.979313 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.979630 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.979975 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.980306 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.980629 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.980949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.981270 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.981607 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.981923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.982245 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.982555 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.982877 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.983212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.983528 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.983836 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.984268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.984600 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.984934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.985260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.985381 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:00.985580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.985934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.986265 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.986583 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.986907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.987223 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.987556 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.987901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.988233 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.988561 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.988872 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.989182 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.989491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.989830 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.990162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.990476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.990784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.991093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.991406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.991712 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.992023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.992329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.992636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.992946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.993251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.993575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.993884 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.994190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.994496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.994802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.995111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.995418 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.995725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.996031 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.996339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.996641 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.996973 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.997307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.997650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.997979 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.998317 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.998981 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.998981 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.999293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.999565 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:00.999885 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.000203 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.000537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.000850 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.001163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.001496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.002333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.002647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.002961 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.003293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.003623 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.003933 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.004260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.004583 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.004909 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.005224 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.005554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.005891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.006205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.006519 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.006838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.007151 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.007467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.007787 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.008106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.008434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.008764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.009092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.009419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.009793 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.010113 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.010458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.010793 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.011110 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.011430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.011740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 21:04:01.011986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 21:04:01.035825 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:01.050969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.context [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1807c78b-3bd1-4707-b15d-964e45f54afd(cell1) {{(pid=117611) load_cells /opt/stack/nova/nova/context.py:464}} May 11 21:04:01.055382 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:01.057006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:01.057847 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:01.059775 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:01.072214 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:01.074516 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:01.101080 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.context [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1807c78b-3bd1-4707-b15d-964e45f54afd(cell1) {{(pid=117612) load_cells /opt/stack/nova/nova/context.py:464}} May 11 21:04:01.105693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:01.107442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:01.108259 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:01.110360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:01.123615 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:01.124312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:01.236907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_db.sqlalchemy.engines [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:01.286182 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_db.sqlalchemy.engines [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 21:04:01.562072 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 21:04:01.569758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 21:04:01.606392 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 21:04:01.615049 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 21:04:01.921168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 21:04:01.927429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: WARNING keystonemiddleware.auth_token [None req-58ee7e4a-a30c-40d4-ac16-2447a5074c44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 21:04:01.932890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5618325ac9c0 pid: 117611 (default app) May 11 21:04:01.962977 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 21:04:01.969102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: WARNING keystonemiddleware.auth_token [None req-acf2e818-0c6d-4df2-83c2-cf3a585c4cbf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 21:04:01.975090 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5618325ac9c0 pid: 117612 (default app) May 11 21:04:45.237678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9dcd68f5-7ade-4305-8f28-b30b272a8b4c tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Action: 'create', calling method: .version_select at 0x7ff8990b4280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1701529983"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:04:46.606254 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1738747372", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "networks": [{"uuid": "5ca805d8-c1cc-4cef-8df1-9746e917e1a9"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:04:47.048049 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] validate_networks() for [('5ca805d8-c1cc-4cef-8df1-9746e917e1a9', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:04:47.381425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9dcd68f5-7ade-4305-8f28-b30b272a8b4c tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.040107 May 11 21:04:47.382239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 1/1] 10.222.0.35 () {60 vars in 1154 bytes} [Wed May 11 21:04:44 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3043 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 21:04:47.387581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f771db55-cd41-4eb8-bbd5-20189bb15a50 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898f0d280>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:47.529292 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f771db55-cd41-4eb8-bbd5-20189bb15a50 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/54e8f618-d157-49ce-9ff9-0216094840c3" status: 200 len: 350 microversion: 2.1 time: 0.145950 May 11 21:04:47.537159 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 2/2] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:47 2022] GET /compute/v2.1/os-volumes/54e8f618-d157-49ce-9ff9-0216094840c3 => generated 350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:47.544529 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4daa8eb4-e61d-48dd-ae84-f9301a76e76e tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898f0d310>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:47.782801 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4daa8eb4-e61d-48dd-ae84-f9301a76e76e tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a" status: 200 len: 345 microversion: 2.1 time: 0.244366 May 11 21:04:47.787463 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 3/3] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:47 2022] GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a => generated 345 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:48.800688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-69196af6-30de-4859-8e7e-978d37a766e1 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898f0da60>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:49.194208 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-69196af6-30de-4859-8e7e-978d37a766e1 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a" status: 200 len: 346 microversion: 2.1 time: 0.072287 May 11 21:04:49.194208 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 4/4] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:48 2022] GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:04:49.194208 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3ce9fdcf-f345-4eb9-a647-c1d62424512e tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Action: 'create', calling method: .version_select at 0x7ff898f160d0>, body: {"snapshot": {"volume_id": "8dd911ec-6676-48b3-b99c-1b5fcea33d3a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-516721696"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:04:49.336055 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:04:49.336494 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:04:49.337137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:04:49.337246 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:04:49.337669 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:04:49.352577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:49.353874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:49.354822 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:49.359453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:49.425446 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Getting quotas for project ba603b859ac34a119a85b6eaef862098. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:04:49.456557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Getting quotas for user 70ae8e6e3ec8401cbc7be32478ec7a89 and project ba603b859ac34a119a85b6eaef862098. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:04:49.486930 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:04:49.496429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:04:49.781230 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5ce605f4-b68b-4825-95e2-b61efb10022a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.840012 May 11 21:04:49.782327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 1/5] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:04:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:04:49.787714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f519b2e0-6968-4dcf-937b-d0b32287cc43 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898eba280>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:49.871401 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3ce9fdcf-f345-4eb9-a647-c1d62424512e tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.993831 May 11 21:04:49.872345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 5/6] 10.222.0.35 () {60 vars in 1161 bytes} [Wed May 11 21:04:48 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:04:49.888528 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3f53d268-2d9d-4c24-8272-06f74ad0ad55 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:49.906952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3f53d268-2d9d-4c24-8272-06f74ad0ad55 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:04:49.918181 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f519b2e0-6968-4dcf-937b-d0b32287cc43 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/a1f5b0a4-cd2c-4809-9cf2-a22fd3d31921" status: 200 len: 351 microversion: 2.1 time: 0.134216 May 11 21:04:49.918980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 2/7] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:49 2022] GET /compute/v2.1/os-volumes/a1f5b0a4-cd2c-4809-9cf2-a22fd3d31921 => generated 351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:49.929593 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3f199e0b-6d71-45fd-b81e-44958aaa6b9a tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff89861be50>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:50.154197 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3f199e0b-6d71-45fd-b81e-44958aaa6b9a tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 200 len: 286 microversion: 2.1 time: 0.233885 May 11 21:04:50.154985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 3/8] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:49 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 286 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:50.166187 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-05870820-a7d1-4f3f-b27c-0dc442f0aa00 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898625550>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:50.266983 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-05870820-a7d1-4f3f-b27c-0dc442f0aa00 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.104646 May 11 21:04:50.267907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 4/9] 10.222.0.35 () {58 vars in 1139 bytes} [Wed May 11 21:04:50 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:50.283032 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a28ec721-3898-46d0-bab1-e207d4c76fba tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898eaaee0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:50.354078 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a28ec721-3898-46d0-bab1-e207d4c76fba tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 200 len: 286 microversion: 2.1 time: 0.078945 May 11 21:04:50.359648 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 5/10] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:50 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:50.374849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3f53d268-2d9d-4c24-8272-06f74ad0ad55 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:04:50.397971 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3f53d268-2d9d-4c24-8272-06f74ad0ad55 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1215 microversion: 2.1 time: 0.524096 May 11 21:04:50.400188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 6/11] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:04:49 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1215 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:04:51.366476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bfc7b21d-179e-4302-b57c-02ad2f4198ea tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898625160>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:51.420015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d441a7c3-7f1c-4961-a54a-8bfa36a59bd3 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:51.420720 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d441a7c3-7f1c-4961-a54a-8bfa36a59bd3 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:04:51.445129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bfc7b21d-179e-4302-b57c-02ad2f4198ea tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 200 len: 286 microversion: 2.1 time: 0.083332 May 11 21:04:51.445727 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 6/12] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:51 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:51.852263 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d441a7c3-7f1c-4961-a54a-8bfa36a59bd3 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:04:51.865793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d441a7c3-7f1c-4961-a54a-8bfa36a59bd3 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1215 microversion: 2.1 time: 0.450345 May 11 21:04:51.877732 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 7/13] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:04:51 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1215 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:04:52.457859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-37e6a892-0bc9-490c-9bc9-f24244b515be tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff89862d160>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:52.500210 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-37e6a892-0bc9-490c-9bc9-f24244b515be tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 200 len: 286 microversion: 2.1 time: 0.044408 May 11 21:04:52.501683 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 7/14] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:52 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:52.884653 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:52.885371 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:04:52.896881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:52.899233 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:52.905268 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:52.907281 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:53.187743 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:04:53.212260 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4169fbc0-e275-4b53-8a94-c59d8ce8212f tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1219 microversion: 2.1 time: 0.330278 May 11 21:04:53.213269 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 8/15] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:04:52 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1219 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:04:53.515429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c0c190f1-ff1c-4a4d-8a27-362216228400 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898625040>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:53.595751 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c0c190f1-ff1c-4a4d-8a27-362216228400 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 200 len: 286 microversion: 2.1 time: 0.086602 May 11 21:04:53.603936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 8/16] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:53 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:54.189510 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4ccade61-fed9-46b4-9188-cab901fd92e2 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898e61280>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:54.232295 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:54.232929 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:04:54.268603 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4ccade61-fed9-46b4-9188-cab901fd92e2 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8b4db7f0-2e9f-4e8c-9618-e867356c76ca" status: 200 len: 351 microversion: 2.1 time: 0.083794 May 11 21:04:54.269190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 9/17] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:54 2022] GET /compute/v2.1/os-volumes/8b4db7f0-2e9f-4e8c-9618-e867356c76ca => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:54.281852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-495e6f63-e87e-402a-b3b3-416658d10f19 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898e66040>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:54.294611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:54.304716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:54.313725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:54.314251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:54.532536 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-495e6f63-e87e-402a-b3b3-416658d10f19 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.255769 May 11 21:04:54.533104 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 10/18] 10.222.0.35 () {58 vars in 1133 bytes} [Wed May 11 21:04:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:04:54.558327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6c91c90f-df9c-4abd-add9-9d00a083eb6d tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898e61d30>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:54.783047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6c91c90f-df9c-4abd-add9-9d00a083eb6d tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.230437 May 11 21:04:54.790571 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 11/19] 10.222.0.35 () {58 vars in 1148 bytes} [Wed May 11 21:04:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:54.795605 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3debf5b2-2c4a-4bfc-b92c-5dd4e5c3f178 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898e66a60>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:54.859480 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3debf5b2-2c4a-4bfc-b92c-5dd4e5c3f178 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 200 len: 287 microversion: 2.1 time: 0.073632 May 11 21:04:54.867317 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 12/20] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:54 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:54.874252 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4f420255-8796-437f-81c4-bc79a27eea8c tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898e66430>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:55.058625 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4f420255-8796-437f-81c4-bc79a27eea8c tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.191824 May 11 21:04:55.064796 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 13/21] 10.222.0.35 () {58 vars in 1133 bytes} [Wed May 11 21:04:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:04:55.075756 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ed45e791-73f3-4367-99ca-35e91705c6f8 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898e66dc0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:55.335191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ed45e791-73f3-4367-99ca-35e91705c6f8 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "DELETE /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 202 len: 0 microversion: 2.1 time: 0.268863 May 11 21:04:55.341951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 14/22] 10.222.0.35 () {58 vars in 1253 bytes} [Wed May 11 21:04:55 2022] DELETE /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:04:55.348788 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9567b924-270f-481c-b921-94ae250edfa9 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898e66280>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:55.428204 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:04:55.461552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-179f8b5c-dda4-48a9-82c1-9c6e9e1e0882 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1267 microversion: 2.1 time: 1.234773 May 11 21:04:55.464748 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 9/23] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:04:54 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1267 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:04:55.477085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-76318f20-fe1f-43f8-8b34-1485a107714a tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898eaaee0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:55.563296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9567b924-270f-481c-b921-94ae250edfa9 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.219309 May 11 21:04:55.564236 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 15/24] 10.222.0.35 () {58 vars in 1166 bytes} [Wed May 11 21:04:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:55.590885 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1c879ad3-ace3-4e6f-8ccb-ce0f19458c72 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898e614c0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:55.610555 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-76318f20-fe1f-43f8-8b34-1485a107714a tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 200 len: 286 microversion: 2.1 time: 0.144529 May 11 21:04:55.612734 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 10/25] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:55 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:55.828755 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1c879ad3-ace3-4e6f-8ccb-ce0f19458c72 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.242177 May 11 21:04:55.838317 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 16/26] 10.222.0.35 () {58 vars in 1169 bytes} [Wed May 11 21:04:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:55.856535 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c9b2ecc1-0960-40ad-946d-d201badfb7ad tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff89856b820>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:56.061213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c9b2ecc1-0960-40ad-946d-d201badfb7ad tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.222686 May 11 21:04:56.069911 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 11/27] 10.222.0.35 () {58 vars in 1154 bytes} [Wed May 11 21:04:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:04:56.076312 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-df063a17-c012-43db-a312-54b2306a7bb5 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff898e61ca0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:56.275899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-df063a17-c012-43db-a312-54b2306a7bb5 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.204391 May 11 21:04:56.283251 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 17/28] 10.222.0.35 () {58 vars in 1187 bytes} [Wed May 11 21:04:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:56.288664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a5edc0b7-b80f-4552-a390-82fbc6f07383 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] Calling method '.version_select at 0x7ff89856b940>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:56.482614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:56.483284 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:04:56.502945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:56.506866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:56.506866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:56.508117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:56.567954 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a5edc0b7-b80f-4552-a390-82fbc6f07383 tempest-VolumesTestJSON-865414367 tempest-VolumesTestJSON-865414367-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.283149 May 11 21:04:56.568861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 12/29] 10.222.0.35 () {58 vars in 1154 bytes} [Wed May 11 21:04:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:04:56.623442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ce9bd33a-51d3-4716-8009-7c080242a62d tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff8985b6700>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:56.671587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-ce9bd33a-51d3-4716-8009-7c080242a62d tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] HTTP exception thrown: Snapshot 70560c32-7fbb-4805-8d92-0e876d472b86 could not be found. May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ce9bd33a-51d3-4716-8009-7c080242a62d tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Request method failure captured: May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 HTTP/1.1 May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCTsyYttpOlMoAKTZeSx8Bo0xm41obmRvJunoURWIfKVxv2JH4Rw1UJM51lEb25HXbAdxkKvs-701fX4x_sdEX6TmegV-QmqpFmksNKo1GsvmIVhSyQ8t7xVGcbUj6bVoeBjZg13x1NENbjcll3izkt-Ybre7DUxQ2GxrOJA6X2YQ7s May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:04:56.681687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d3fefcc4859a4b2ebcb733e54f98e98a May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Snapshot 70560c32-7fbb-4805-8d92-0e876d472b86 could not be found. May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '70560c32-7fbb-4805-8d92-0e876d472b86'} May 11 21:04:56.682950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 70560c32-7fbb-4805-8d92-0e876d472b86 could not be found. (HTTP 404) (Request-ID: req-e0fdb557-2f0d-43e0-aa50-351099ade1d1) May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:56.683594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:04:56.684488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 70560c32-7fbb-4805-8d92-0e876d472b86 could not be found. May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 11 21:04:56.685423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 70560c32-7fbb-4805-8d92-0e876d472b86 could not be found. May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 70560c32-7fbb-4805-8d92-0e876d472b86 could not be found. May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ce9bd33a-51d3-4716-8009-7c080242a62d tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Returning 404 to user: Snapshot 70560c32-7fbb-4805-8d92-0e876d472b86 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:04:56.686428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ce9bd33a-51d3-4716-8009-7c080242a62d tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86" status: 404 len: 111 microversion: 2.1 time: 0.063408 May 11 21:04:56.692342 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 13/30] 10.222.0.35 () {58 vars in 1250 bytes} [Wed May 11 21:04:56 2022] GET /compute/v2.1/os-snapshots/70560c32-7fbb-4805-8d92-0e876d472b86 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:04:56.700788 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0b73fd78-f222-4abc-8a8c-68374956ac77 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff8985049d0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:57.118311 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:04:57.118424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0b73fd78-f222-4abc-8a8c-68374956ac77 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a" status: 202 len: 0 microversion: 2.1 time: 0.419351 May 11 21:04:57.118424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 14/31] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:04:56 2022] DELETE /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:04:57.124526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-19eebb3f-40f2-415f-844c-53af8a4b8550 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1273 microversion: 2.1 time: 0.647172 May 11 21:04:57.128674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 18/32] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:04:56 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1273 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:04:57.143463 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2d471f5f-c80a-4da4-bb01-75603aaa31c5 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898e08ee0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:57.227108 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2d471f5f-c80a-4da4-bb01-75603aaa31c5 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a" status: 200 len: 345 microversion: 2.1 time: 0.087955 May 11 21:04:57.227640 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 19/33] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:57 2022] GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:57.558904 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d25dc493-37cc-4d2f-8022-37e3af231895 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'create', calling method: .version_select at 0x7ff898504f70>, body: {"keypair": {"name": "tempest-keypair-631019521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK98L07EBL0GpH/J4XhBmuaejYNtzIJI9lrxeA+zXMSO0UVQ+RqpjLrFEBTZAB6p8HPEr0xmZbwTna7zydYSElB6wRhBgvGJemxfbdQ/hv4FXUsYUiLaKG4i+i4HIaSH1g=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:04:57.613419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d25dc493-37cc-4d2f-8022-37e3af231895 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:04:57.619537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d25dc493-37cc-4d2f-8022-37e3af231895 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for user f9968edcee104432ade2014e39683bb5 and project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:04:57.785460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d25dc493-37cc-4d2f-8022-37e3af231895 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.665054 May 11 21:04:57.786158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 15/34] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:04:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:04:58.147600 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:58.153963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:04:58.163813 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:58.171452 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:58.181439 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:04:58.185711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:04:58.242859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fb01d0ec-4ba8-417b-a95e-66b56606365b tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff898484430>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:58.309946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-fb01d0ec-4ba8-417b-a95e-66b56606365b tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] HTTP exception thrown: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fb01d0ec-4ba8-417b-a95e-66b56606365b tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Request method failure captured: May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a HTTP/1.1 May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCTsyYttpOlMoAKTZeSx8Bo0xm41obmRvJunoURWIfKVxv2JH4Rw1UJM51lEb25HXbAdxkKvs-701fX4x_sdEX6TmegV-QmqpFmksNKo1GsvmIVhSyQ8t7xVGcbUj6bVoeBjZg13x1NENbjcll3izkt-Ybre7DUxQ2GxrOJA6X2YQ7s May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:04:58.313810 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d3fefcc4859a4b2ebcb733e54f98e98a May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '8dd911ec-6676-48b3-b99c-1b5fcea33d3a'} May 11 21:04:58.315222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. (HTTP 404) (Request-ID: req-3193e157-70ba-4943-83d2-7cab71e8d883) May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.316267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:04:58.317721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 21:04:58.318949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.320152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.322100 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fb01d0ec-4ba8-417b-a95e-66b56606365b tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Returning 404 to user: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:04:58.323312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fb01d0ec-4ba8-417b-a95e-66b56606365b tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a" status: 404 len: 109 microversion: 2.1 time: 0.086853 May 11 21:04:58.324497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 16/35] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:58 2022] GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:04:58.341173 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7d84afc5-e1fd-46c7-a0c4-dbd56137c204 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff89849e160>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:58.407653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-7d84afc5-e1fd-46c7-a0c4-dbd56137c204 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] HTTP exception thrown: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7d84afc5-e1fd-46c7-a0c4-dbd56137c204 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Request method failure captured: May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a HTTP/1.1 May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCTsyYttpOlMoAKTZeSx8Bo0xm41obmRvJunoURWIfKVxv2JH4Rw1UJM51lEb25HXbAdxkKvs-701fX4x_sdEX6TmegV-QmqpFmksNKo1GsvmIVhSyQ8t7xVGcbUj6bVoeBjZg13x1NENbjcll3izkt-Ybre7DUxQ2GxrOJA6X2YQ7s May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:04:58.409804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d3fefcc4859a4b2ebcb733e54f98e98a May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '8dd911ec-6676-48b3-b99c-1b5fcea33d3a'} May 11 21:04:58.410949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. (HTTP 404) (Request-ID: req-79d8ef26-ba4d-4d25-a860-a846c5eb9686) May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.411616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 21:04:58.412526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 21:04:58.413459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7d84afc5-e1fd-46c7-a0c4-dbd56137c204 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Returning 404 to user: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:04:58.414888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7d84afc5-e1fd-46c7-a0c4-dbd56137c204 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a" status: 404 len: 109 microversion: 2.1 time: 0.077036 May 11 21:04:58.416158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 17/36] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:04:58 2022] DELETE /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:04:58.421042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ab937278-4a58-43d8-8e79-8ae538b1fcc0 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Calling method '.version_select at 0x7ff8984843a0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:04:58.523091 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-ab937278-4a58-43d8-8e79-8ae538b1fcc0 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] HTTP exception thrown: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ab937278-4a58-43d8-8e79-8ae538b1fcc0 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Request method failure captured: May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a HTTP/1.1 May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCTsyYttpOlMoAKTZeSx8Bo0xm41obmRvJunoURWIfKVxv2JH4Rw1UJM51lEb25HXbAdxkKvs-701fX4x_sdEX6TmegV-QmqpFmksNKo1GsvmIVhSyQ8t7xVGcbUj6bVoeBjZg13x1NENbjcll3izkt-Ybre7DUxQ2GxrOJA6X2YQ7s May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:04:58.525609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/3f88ec88dc464807b966bc9fe0f17e56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 3f88ec88dc464807b966bc9fe0f17e56 May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1897937833 May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d3fefcc4859a4b2ebcb733e54f98e98a May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1897937833-project May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '8dd911ec-6676-48b3-b99c-1b5fcea33d3a'} May 11 21:04:58.526801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. (HTTP 404) (Request-ID: req-f372573d-3a6d-407a-8bc0-00fbc9b38281) May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.527433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:04:58.528375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 21:04:58.529281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. May 11 21:04:58.530289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:04:58.532967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ab937278-4a58-43d8-8e79-8ae538b1fcc0 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] Returning 404 to user: Volume 8dd911ec-6676-48b3-b99c-1b5fcea33d3a could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:04:58.534192 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ab937278-4a58-43d8-8e79-8ae538b1fcc0 tempest-VolumesSnapshotsTestJSON-1897937833 tempest-VolumesSnapshotsTestJSON-1897937833-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a" status: 404 len: 109 microversion: 2.1 time: 0.117589 May 11 21:04:58.534914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 18/37] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:04:58 2022] GET /compute/v2.1/os-volumes/8dd911ec-6676-48b3-b99c-1b5fcea33d3a => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:05:00.121204 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:00.130425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f985ed80-8f40-4e16-bd10-3ccdc61b612a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 1.987057 May 11 21:05:00.132559 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 20/38] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:04:58 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:01.154532 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:01.158159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:01.179250 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:01.180080 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:01.180935 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:01.181404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:01.906505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:01.920337 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3b43eee2-bf8e-4047-b266-430677f18fa9 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.775453 May 11 21:05:01.934636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 19/39] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:01 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:02.938162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:02.939677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:02.965439 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:03.003655 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:03.005659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:03.005659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:03.665946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0afde453-aa82-418b-a6a3-bf18969a3cbb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: .version_select at 0x7ff898edea60>, body: {"keypair": {"name": "tempest-keypair-337329189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIg7ICN9Vz29R7I0hR0qZz/p7Sp0MhOqJ21YUepe9NExxqPS7bHLiBd5YqJ5Q7lTQFei+WL1FrX65Rx2//I/Vqmex7g1IvwlwZHr/NMzYraaRQJu45yZXmoTTRLods64Q=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:03.866389 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-0afde453-aa82-418b-a6a3-bf18969a3cbb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:05:03.893036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-0afde453-aa82-418b-a6a3-bf18969a3cbb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:05:04.158749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0afde453-aa82-418b-a6a3-bf18969a3cbb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.663940 May 11 21:05:04.165858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 21/40] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:05:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:05.238488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:05.258212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c1d8e506-f8d7-44c4-b393-6fa3f9d84c14 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 2.324763 May 11 21:05:05.270075 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 20/41] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:02 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:05.555621 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d6ae7484-66d1-43b5-9bfe-d1a47d4dec0c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'create', calling method: .version_select at 0x7ff898dfa940>, body: {"keypair": {"name": "tempest-keypair-1722104961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhbjtDQ9zGSnjxTs6IXwN430+vD9lAF8+pW046WAsF7/9EbW6zuGFXy/0hn6zG0LP3pGlOEFRTJ597HASe5Bf5xLc5xj0piv1Wuc33MeJH8BmTeC5YCkkOxhWGB+HaHvQ=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:05.575611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-d6ae7484-66d1-43b5-9bfe-d1a47d4dec0c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:05:05.581913 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-d6ae7484-66d1-43b5-9bfe-d1a47d4dec0c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for user d7666a6299cc4c44ac7495ed00f137dd and project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:05:05.654515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-cf68d88a-29d1-4652-b390-9d95c6e5469a req-8aa1b674-ce14-4391-b7c1-4501cb003474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c813c1-9c8c-4614-a5dc-a21b2a13cdcd", "tag": "5f7e5f06-1d67-4fab-9fdc-7d34f9f7c9ab"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:05.678755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cf68d88a-29d1-4652-b390-9d95c6e5469a req-8aa1b674-ce14-4391-b7c1-4501cb003474 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:05.679532 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cf68d88a-29d1-4652-b390-9d95c6e5469a req-8aa1b674-ce14-4391-b7c1-4501cb003474 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:05.735980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-cf68d88a-29d1-4652-b390-9d95c6e5469a req-8aa1b674-ce14-4391-b7c1-4501cb003474 service nova] Creating event network-changed:5f7e5f06-1d67-4fab-9fdc-7d34f9f7c9ab for instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd on hv-cinder-84146 May 11 21:05:05.738533 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cf68d88a-29d1-4652-b390-9d95c6e5469a req-8aa1b674-ce14-4391-b7c1-4501cb003474 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 21:05:05.743255 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0976302e-d6f4-4d3b-a1f3-25e83d644f34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:05.744130 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0976302e-d6f4-4d3b-a1f3-25e83d644f34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:05.745892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0976302e-d6f4-4d3b-a1f3-25e83d644f34 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:05.746834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0976302e-d6f4-4d3b-a1f3-25e83d644f34 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:05.755212 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d6ae7484-66d1-43b5-9bfe-d1a47d4dec0c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.853027 May 11 21:05:05.761319 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 22/42] 10.222.0.35 () {62 vars in 1199 bytes} [Wed May 11 21:05:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 856 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 11 21:05:05.777874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.compute.rpcapi [None req-0976302e-d6f4-4d3b-a1f3-25e83d644f34 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 21:05:05.781574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0976302e-d6f4-4d3b-a1f3-25e83d644f34 None None] Releasing lock "compute-rpcapi-router" {{(pid=117612) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 21:05:05.817925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0976302e-d6f4-4d3b-a1f3-25e83d644f34 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.534019 May 11 21:05:05.819765 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 21/43] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:05:06.286054 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:06.287106 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:06.324246 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:06.328366 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:06.330341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:06.332839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:07.015525 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:07.036449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-47be8dae-350a-4c35-9af0-78b4df176f79 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.756628 May 11 21:05:07.059061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 23/44] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:06 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:08.076936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:08.077785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:08.096363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:08.098902 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:08.100154 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:08.100797 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:08.649885 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:08.661184 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-03064196-d0c9-4f56-bf7b-06f5e0c8305d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.589659 May 11 21:05:08.664238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 22/45] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:08 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:09.682611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:09.683234 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:09.697653 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:09.698138 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:09.699083 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:09.699520 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:10.353289 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:10.367376 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3f3ed859-83f7-4db8-84ce-db9735364639 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.690933 May 11 21:05:10.372791 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 24/46] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:09 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:10.546814 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1548573291", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26111c2a-0c3d-4253-b45f-aeacb402f250"}], "security_groups": [{"name": "tempest-securitygroup--1033839476"}], "key_name": "tempest-keypair-631019521", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:10.831346 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] validate_networks() for [('26111c2a-0c3d-4253-b45f-aeacb402f250', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:05:11.384423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:11.385358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:11.395929 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:11.405155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:11.406375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:11.406996 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:11.720353 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:05:11.722510 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:05:11.723050 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:05:11.726853 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:05:11.727339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:05:11.761974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:11.762436 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:11.763248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:11.766861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:11.839771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:05:11.852071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for user f9968edcee104432ade2014e39683bb5 and project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:05:11.882736 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:05:11.887644 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:11.889723 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:05:11.904911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ff27479f-4b3a-45be-8968-cc2089f5ac6d tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.522923 May 11 21:05:11.908554 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 25/47] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:11 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:11.946159 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-258870073", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d70e35-28da-4d4e-9ed9-625e30aef3e3"}], "security_groups": [{"name": "tempest-securitygroup--344339692"}], "key_name": "tempest-keypair-337329189", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:12.150472 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] validate_networks() for [('93d70e35-28da-4d4e-9ed9-625e30aef3e3', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:05:12.343388 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3a1e7b52-5846-4e5f-8b18-e62465860995 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.805742 May 11 21:05:12.346244 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 23/48] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:05:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:05:12.374925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-da53f811-229b-4f4b-a9aa-82ad0844a298 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:12.379579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-da53f811-229b-4f4b-a9aa-82ad0844a298 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:12.541506 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da53f811-229b-4f4b-a9aa-82ad0844a298 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:12.557225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-da53f811-229b-4f4b-a9aa-82ad0844a298 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1237 microversion: 2.1 time: 0.200998 May 11 21:05:12.565970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 24/49] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:12 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1237 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:12.924730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:12.925389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:12.931397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:12.931782 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:12.932552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:12.937444 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:13.081599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:13.089949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8f0489ae-8138-4303-bb04-0c05d0503581 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.170291 May 11 21:05:13.100062 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 25/50] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:12 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:13.129998 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-897391445", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cba3ba85-9c39-4c2e-a36c-66082d4dfb25"}], "security_groups": [{"name": "tempest-securitygroup--675340032"}], "key_name": "tempest-keypair-1722104961", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:13.322363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] validate_networks() for [('cba3ba85-9c39-4c2e-a36c-66082d4dfb25', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:05:13.416037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:05:13.416696 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:05:13.417170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:05:13.417635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:05:13.418377 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:05:13.428223 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:13.428677 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:13.429482 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:13.429947 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:13.452936 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:05:13.457042 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:05:13.474821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:05:13.478415 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:05:13.658577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1fab797e-4e38-45c8-89e2-ec60b82f8a8c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.746104 May 11 21:05:13.659245 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 26/51] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:05:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:05:13.700186 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-171cb0ce-3630-4b1d-8c05-6ae56db5b479 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:13.703019 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-171cb0ce-3630-4b1d-8c05-6ae56db5b479 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:13.790508 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-171cb0ce-3630-4b1d-8c05-6ae56db5b479 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:13.799450 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-171cb0ce-3630-4b1d-8c05-6ae56db5b479 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1237 microversion: 2.1 time: 0.138991 May 11 21:05:13.800082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 27/52] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:13 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1237 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:13.813493 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-78b2f845-31a6-4884-8c18-536ec9b3738b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:13.815898 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-78b2f845-31a6-4884-8c18-536ec9b3738b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:13.876113 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:05:13.876835 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:05:13.877571 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:05:13.878211 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:05:13.879196 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:05:13.891357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:13.891870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:13.892805 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:13.893478 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:13.913401 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:05:13.915103 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-78b2f845-31a6-4884-8c18-536ec9b3738b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:13.921454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for user d7666a6299cc4c44ac7495ed00f137dd and project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:05:13.936633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-78b2f845-31a6-4884-8c18-536ec9b3738b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1240 microversion: 2.1 time: 0.134883 May 11 21:05:13.938137 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 28/53] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:13 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:13.968120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:05:13.973839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:05:14.107657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:14.108279 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:14.114535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:14.114995 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:14.115762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:14.116208 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:14.137926 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-746e31d0-488a-4736-94d4-1d45dfa72233 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.029603 May 11 21:05:14.139469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 26/54] 10.222.0.35 () {62 vars in 1187 bytes} [Wed May 11 21:05:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 21:05:14.151075 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8bc888d0-3e5b-4fec-a5c0-4dd4c7b63a0a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:14.156296 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8bc888d0-3e5b-4fec-a5c0-4dd4c7b63a0a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:14.241993 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8bc888d0-3e5b-4fec-a5c0-4dd4c7b63a0a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:14.253081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8bc888d0-3e5b-4fec-a5c0-4dd4c7b63a0a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:14.254618 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8bc888d0-3e5b-4fec-a5c0-4dd4c7b63a0a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:14.256143 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8bc888d0-3e5b-4fec-a5c0-4dd4c7b63a0a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1281 microversion: 2.20 time: 0.110746 May 11 21:05:14.257718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 27/55] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:14 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:14.328582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:14.340243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-37daaf06-7d28-46cf-84ec-d8acc27445e4 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.232484 May 11 21:05:14.340243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 29/56] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:14 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:14.817037 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:14.817688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:14.825031 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:14.825480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:14.826324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:14.826763 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:14.958709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3fe71072-b457-484c-9541-7d2d390d14cc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:14.959336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3fe71072-b457-484c-9541-7d2d390d14cc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:14.962696 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:14.973785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-da56b632-a464-4866-9ada-982d3b5893d7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1233 microversion: 2.1 time: 0.160523 May 11 21:05:14.977860 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 28/57] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:14 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1233 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:15.034128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3fe71072-b457-484c-9541-7d2d390d14cc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:15.040719 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3fe71072-b457-484c-9541-7d2d390d14cc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1240 microversion: 2.1 time: 0.089629 May 11 21:05:15.041282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 30/58] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:14 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:15.275633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8786e81f-aabb-4fb2-834b-721ec67268f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:15.276305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8786e81f-aabb-4fb2-834b-721ec67268f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:15.338722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8786e81f-aabb-4fb2-834b-721ec67268f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:15.346310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8786e81f-aabb-4fb2-834b-721ec67268f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:15.347851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8786e81f-aabb-4fb2-834b-721ec67268f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:15.349029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8786e81f-aabb-4fb2-834b-721ec67268f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1281 microversion: 2.20 time: 0.077823 May 11 21:05:15.350150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 29/59] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:15 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:15.355427 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:15.356359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:15.362597 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:15.363043 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:15.365459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:15.365459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:15.546978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:15.558728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c5e9cef0-fb8b-4d06-9007-9df55c188afb tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.206762 May 11 21:05:15.559706 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 31/60] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:15 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:15.991437 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:15.992124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:16.001217 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.001868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.003016 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.003824 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.058469 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:16.059708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:16.068399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.069901 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.070870 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.071407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.143508 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:16.146686 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:16.156863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-42b69408-52d2-470c-8803-b97217607e01 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1297 microversion: 2.1 time: 0.169072 May 11 21:05:16.162816 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 30/61] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:15 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1297 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:16.166832 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4342f0c4-3aa0-46e1-8a85-58eec9647aaf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1292 microversion: 2.1 time: 0.112673 May 11 21:05:16.181795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 32/62] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:16 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1292 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:16.367377 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:16.367986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:16.377378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.377859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.378636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.379071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.481436 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:16.490905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:16.492606 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:16.494400 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8b868050-55a2-4f14-8833-2d349a20a8fe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1333 microversion: 2.20 time: 0.131000 May 11 21:05:16.495460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 31/63] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:16 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:16.577495 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:16.579778 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:16.589139 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.589831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.593679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:16.594606 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:16.806610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:16.813920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6435b9ff-2bda-4bda-9e76-1a1247afedf2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.241944 May 11 21:05:16.815609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 33/64] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:16 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:17.178009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:17.179284 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:17.189398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:17.190272 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:17.201447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.202037 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.202524 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.210055 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.213404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.213891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.218281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.218741 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.478308 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:17.478308 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8c8dd67c-2c70-4949-9a89-b3fb2225a1ba tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1310 microversion: 2.1 time: 0.269962 May 11 21:05:17.478308 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 34/65] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:17 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1310 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:17.516748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:17.517362 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:17.541331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.542256 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.543267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.545916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.587491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:17.595643 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5e55ff9b-5983-484e-8be7-8a1492cea6c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.421411 May 11 21:05:17.600567 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 32/66] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:17 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:17.663676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:17.672725 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:17.673161 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:17.674508 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9b802d67-ab88-437e-9339-5f1de95b7ae3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1341 microversion: 2.20 time: 0.163896 May 11 21:05:17.675540 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 35/67] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:17 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:05:17.833186 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:17.833881 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:17.840156 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.840910 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.842502 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:17.843130 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:17.982143 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:17.989804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-543a09ac-83b4-4eab-90a4-b098fb89c78a tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.160705 May 11 21:05:17.990370 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 33/68] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:17 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:18.501675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:18.506495 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:18.519794 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.524844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.526596 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.527291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.628992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:18.634932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:18.661293 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:18.662964 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.667417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.674237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ffebdf7c-5a98-43c4-9ecc-62f30343dbf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1298 microversion: 2.1 time: 0.177137 May 11 21:05:18.674413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.676253 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.676670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 36/69] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:18 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:18.692983 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:18.693421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:18.703718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.704175 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.706139 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.706754 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.843309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:18.877856 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:18.882763 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:18.885069 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1c07b1dc-22de-4cd9-ae4d-1688231cc3a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1339 microversion: 2.20 time: 0.196200 May 11 21:05:18.886555 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 37/70] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:18 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:18.940109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-c3a380d0-c5ed-484f-ad4b-f7ef212df29d req-ba6fe3ca-648b-4149-8e94-d2b7f020c924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925e3d97-64b1-4637-9850-0c37d5f2a870", "tag": "5c51e32e-4186-43e2-9063-ee5936dea096"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:18.958800 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c3a380d0-c5ed-484f-ad4b-f7ef212df29d req-ba6fe3ca-648b-4149-8e94-d2b7f020c924 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.959465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c3a380d0-c5ed-484f-ad4b-f7ef212df29d req-ba6fe3ca-648b-4149-8e94-d2b7f020c924 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.985514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-c3a380d0-c5ed-484f-ad4b-f7ef212df29d req-ba6fe3ca-648b-4149-8e94-d2b7f020c924 service nova] Creating event network-changed:5c51e32e-4186-43e2-9063-ee5936dea096 for instance 925e3d97-64b1-4637-9850-0c37d5f2a870 on hv-cinder-84146 May 11 21:05:18.986243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c3a380d0-c5ed-484f-ad4b-f7ef212df29d req-ba6fe3ca-648b-4149-8e94-d2b7f020c924 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 21:05:18.987670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ab7a7e6-d5f9-4837-9bff-636b0cd1f883 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.988541 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ab7a7e6-d5f9-4837-9bff-636b0cd1f883 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.989784 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ab7a7e6-d5f9-4837-9bff-636b0cd1f883 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:18.990367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ab7a7e6-d5f9-4837-9bff-636b0cd1f883 None None] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:18.999925 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.compute.rpcapi [None req-2ab7a7e6-d5f9-4837-9bff-636b0cd1f883 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 21:05:19.009431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ab7a7e6-d5f9-4837-9bff-636b0cd1f883 None None] Releasing lock "compute-rpcapi-router" {{(pid=117611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 21:05:19.046443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2ab7a7e6-d5f9-4837-9bff-636b0cd1f883 None None] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114185 May 11 21:05:19.047603 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 38/71] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:19.057256 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:19.058271 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:19.070968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:19.072662 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:19.073659 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:19.077346 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:19.179264 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:19.186979 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ea41e07c-d860-4848-8376-58d50b2eb353 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.576179 May 11 21:05:19.187911 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 34/72] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:18 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:19.332185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:19.339741 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9534d10a-81a4-449b-bef0-2f3e1e19d612 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.290667 May 11 21:05:19.341407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 39/73] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:19 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:19.692913 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:19.693653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:19.700035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:19.700701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:19.706146 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:19.706146 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.020488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:20.020488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-17e7bd30-b64a-4c8d-9a7f-83705cad6a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.170347 May 11 21:05:20.020488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 35/74] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:19 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:20.022112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:20.022112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:20.022112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.022112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.023235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.023235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.203726 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:20.204741 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:20.224404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.224404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.224404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.224650 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:20.224745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.231726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:20.233812 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:20.235049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d4f56ed4-1364-41e5-9fbb-2ea9d62f7117 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.335104 May 11 21:05:20.235705 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 40/75] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:19 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:20.359337 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:20.359994 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:20.366152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.366611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.367396 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.367856 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.507040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:20.515618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-25aaf6d8-746d-4238-83b3-9309a94e64e8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.161142 May 11 21:05:20.516212 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 41/76] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:20 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:20.545990 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:20.553280 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6b19160a-ef7a-40a2-ab46-4cbf3d7fc8f5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.353302 May 11 21:05:20.553811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 36/77] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:20 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:20.876328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:20.877024 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:20.883049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.888098 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:20.888098 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:20.888098 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:21.029129 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:21.036566 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e1877ebc-7517-49d5-b856-c8a53e47cb0f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.164498 May 11 21:05:21.037566 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 42/78] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:20 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:21.257392 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:21.263308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:21.274877 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:21.275408 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:21.276544 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:21.277131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:21.423338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:21.431400 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:21.433161 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:21.434301 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-08176988-49d3-428e-ba39-db19dbf418a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.183733 May 11 21:05:21.435774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 37/79] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:21 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:21.532275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:21.532884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:21.538980 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:21.545122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:21.545122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:21.545122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:21.590305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:21.590828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:21.610095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:21.610560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:21.611344 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:21.611952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:21.883239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:21.897073 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a4b14544-a22b-4868-ac90-b89cc1454741 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.368689 May 11 21:05:21.900679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 43/80] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:21 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:22.057024 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:22.058491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:22.067573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:22.069568 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:22.070511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:22.072327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:22.220115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:22.238129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f23627f3-d8db-4308-ba65-8bed2c276e6d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.671249 May 11 21:05:22.240009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 38/81] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:21 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:22.397057 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-7f7fe7ae-6d3d-4025-abc9-09e94ca09125 req-78072992-62d2-4512-bd78-5cdc5c68d70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c813c1-9c8c-4614-a5dc-a21b2a13cdcd", "name": "network-vif-plugged", "status": "completed", "tag": "5f7e5f06-1d67-4fab-9fdc-7d34f9f7c9ab"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:22.406892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7f7fe7ae-6d3d-4025-abc9-09e94ca09125 req-78072992-62d2-4512-bd78-5cdc5c68d70b service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:22.407342 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7f7fe7ae-6d3d-4025-abc9-09e94ca09125 req-78072992-62d2-4512-bd78-5cdc5c68d70b service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:22.419882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-7f7fe7ae-6d3d-4025-abc9-09e94ca09125 req-78072992-62d2-4512-bd78-5cdc5c68d70b service nova] Creating event network-vif-plugged:5f7e5f06-1d67-4fab-9fdc-7d34f9f7c9ab for instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd on hv-cinder-84146 May 11 21:05:22.425288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-7f7fe7ae-6d3d-4025-abc9-09e94ca09125 req-78072992-62d2-4512-bd78-5cdc5c68d70b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113525 May 11 21:05:22.429102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 39/82] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:22.447362 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:22.453982 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:22.454894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:22.461719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:22.462529 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:22.463376 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8fb9265-7a5b-4780-946a-6511e8991038 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.408723 May 11 21:05:22.463791 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:22.464434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:22.475616 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 44/83] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:22 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:22.617928 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:22.626430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:22.627964 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:22.629344 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9b87dd39-967b-4d47-98a2-7c494f2b43a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.180744 May 11 21:05:22.630006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 40/84] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:22 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:22.915639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:22.916438 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:22.925709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:22.926398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:22.927591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:22.934850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:23.234668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:23.242282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-62641200-4303-4151-966d-fa71dbdfd6b1 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.330816 May 11 21:05:23.243070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 45/85] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:22 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:23.256533 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:23.259742 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:23.263324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:23.263775 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:23.264548 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:23.264983 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:23.395460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:23.404159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-033ddece-b39c-45bc-aff0-37808596f96f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.150970 May 11 21:05:23.404840 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 41/86] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:23 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:23.483535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:23.490343 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:23.502233 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:23.502695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:23.503484 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:23.504389 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:23.648661 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:23.649562 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:23.663477 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:23.664150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:23.666803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:23.667458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:23.928304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:23.936814 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:23.938435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:23.939951 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5fd0f6e4-fd2d-4d63-88fd-8134b150dc02 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.295965 May 11 21:05:23.940749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 42/87] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:23 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:05:23.941563 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:23.962782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5847fd19-01c7-440b-b86d-07cc79c30e3a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.485511 May 11 21:05:23.973637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 46/88] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:23 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:24.003686 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-54c75130-04b8-483d-9500-11b1a0463953 req-6b36934f-80fc-497f-9146-67ab5888a6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a0c714-2a75-4c5a-b97c-bd3407687b16", "tag": "b5d7d61f-ac27-420d-a3ea-7fdaecaeed05"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:24.011361 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-54c75130-04b8-483d-9500-11b1a0463953 req-6b36934f-80fc-497f-9146-67ab5888a6ef service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.011805 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-54c75130-04b8-483d-9500-11b1a0463953 req-6b36934f-80fc-497f-9146-67ab5888a6ef service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.022985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-54c75130-04b8-483d-9500-11b1a0463953 req-6b36934f-80fc-497f-9146-67ab5888a6ef service nova] Creating event network-changed:b5d7d61f-ac27-420d-a3ea-7fdaecaeed05 for instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 on hv-cinder-84146 May 11 21:05:24.027921 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-54c75130-04b8-483d-9500-11b1a0463953 req-6b36934f-80fc-497f-9146-67ab5888a6ef service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085765 May 11 21:05:24.028541 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 43/89] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:24.259146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:24.259959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:24.266232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.266697 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.267442 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.267881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.393799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:24.401291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a1d30fc8-2700-4274-8764-a3e520811911 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.145965 May 11 21:05:24.401884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 47/90] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:24 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:24.421309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:24.422186 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:24.428491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.429010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.431599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.431599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.577300 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:24.584707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-20bdf4fe-a4fe-4566-b2e8-0b31566f6188 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.168278 May 11 21:05:24.585454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 44/91] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:24 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:24.959860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:24.960634 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:24.967161 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.968264 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.969095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.969760 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.980286 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:24.981263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:24.988084 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.988706 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:24.991320 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:24.991320 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:25.150719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:25.158789 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6adbd028-acde-491c-baa3-0cf60880d4e0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.182443 May 11 21:05:25.160029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 45/92] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:24 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:25.396413 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:25.404495 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:25.406202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:25.407948 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f5beb7ca-9960-4f6d-a1d8-019baff48fe3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.452811 May 11 21:05:25.411042 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 48/93] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:24 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:25.424400 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:25.425787 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:25.432177 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:25.432621 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:25.433565 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:25.434349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:25.605307 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:25.606204 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:25.614948 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:25.615797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:25.619016 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:25.619578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:25.644805 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:25.655347 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6681e14a-12ee-4e08-9240-895e4a8447cd tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.235279 May 11 21:05:25.660898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 46/94] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:25 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:25.948275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:25.955490 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b7db3a2f-f2e2-4648-989f-19ede050f8e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.356919 May 11 21:05:25.956049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 49/95] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:25 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:26.042097 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-33185320-ddae-4f46-8544-457235c71c67 req-d6d92b61-13b1-48e5-9816-f2aeef6ba908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e6f4c2-0bcd-4a54-854f-638f98f48a25", "tag": "17516495-e3a1-4e3b-9f09-7e6a38573ceb"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:26.050749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-33185320-ddae-4f46-8544-457235c71c67 req-d6d92b61-13b1-48e5-9816-f2aeef6ba908 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.051214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-33185320-ddae-4f46-8544-457235c71c67 req-d6d92b61-13b1-48e5-9816-f2aeef6ba908 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.062410 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-33185320-ddae-4f46-8544-457235c71c67 req-d6d92b61-13b1-48e5-9816-f2aeef6ba908 service nova] Creating event network-changed:17516495-e3a1-4e3b-9f09-7e6a38573ceb for instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 on hv-cinder-84146 May 11 21:05:26.067437 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-33185320-ddae-4f46-8544-457235c71c67 req-d6d92b61-13b1-48e5-9816-f2aeef6ba908 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028947 May 11 21:05:26.068019 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 47/96] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:26.176789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:26.177315 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:26.183270 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.183790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.184608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.185052 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.315429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:26.322619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4c565556-8af4-433e-b315-384efbbf74b8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.149776 May 11 21:05:26.323168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 50/97] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:26 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:26.429083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:26.429737 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:26.435856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.436304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.437066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.437650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.566029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:26.574199 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:26.576241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:26.577870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-71711937-84d4-4c3f-96ff-8bca4f1f3c9d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.153780 May 11 21:05:26.578438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 48/98] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:26 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:26.675152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:26.675741 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:26.681662 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.682049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.682982 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.683414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.813120 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:26.822717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fefd545b-f88e-49ba-bfa5-89095e8c4f13 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.151201 May 11 21:05:26.833039 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 51/99] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:26 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:26.972732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:26.973340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:26.979089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.979535 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:26.980298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:26.980730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:27.127440 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:27.135013 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eaf6bca0-701f-437e-b9c0-c9fb287666ff tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.166010 May 11 21:05:27.135946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 49/100] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:26 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:27.339374 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:27.340329 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:27.347259 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:27.347831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:27.348695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:27.349195 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:27.480654 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:27.487886 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c7ce3611-6693-4718-beb0-ef0e01f73a57 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.152548 May 11 21:05:27.488471 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 52/101] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:27 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:27.595909 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:27.596553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:27.602531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:27.603006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:27.603787 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:27.604213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:27.732653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:27.741934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:27.748072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:27.748072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-07ccc963-1d07-465d-8629-e8ef02c2e399 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.153330 May 11 21:05:27.748072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 50/102] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:27 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:27.839840 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:27.840445 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:27.846652 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:27.847574 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:27.847845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:27.848270 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:27.982277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:27.990052 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3afb8443-a48a-45f1-8591-2856321d8b75 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.154083 May 11 21:05:27.990619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 53/103] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:27 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:28.152440 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:28.153045 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:28.158764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:28.159208 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:28.159976 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:28.160443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:28.295007 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:28.306304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6ee5bc30-37c8-4d58-9b13-952c82674dc1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.157608 May 11 21:05:28.306984 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 51/104] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:28 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:28.504205 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:28.504749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:28.510582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:28.511033 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:28.511798 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:28.512235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:28.640473 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:28.648207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e4d2b3b4-9774-41c4-ae91-10796973e352 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.147830 May 11 21:05:28.648831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 54/105] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:28 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:28.763470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:28.764126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:28.770767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:28.771558 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:28.772428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:28.772935 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:29.009068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:29.009720 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:29.017573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:29.018395 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:29.019326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:29.019943 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:29.118269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:29.128824 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:29.131524 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:29.133005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8f5e3e11-8511-436b-a309-641a299f226d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.373585 May 11 21:05:29.134062 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 52/106] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:28 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:29.329458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:29.330544 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:29.351793 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:29.352252 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:29.359011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:29.359742 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:29.418916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:29.443500 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2e93e8ff-b859-4793-b6bf-9f2ed4e2b8ec tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1315 microversion: 2.1 time: 0.439411 May 11 21:05:29.454454 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 55/107] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:29 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:29.606888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:29.620563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f0115fa6-5fec-4331-9c83-a5d5c689aeb1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.299304 May 11 21:05:29.621354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 53/108] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:29 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:29.669376 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:29.670398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:29.681648 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:29.682377 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:29.683865 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:29.684577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:29.881152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:29.889099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5805bbc6-cbec-412d-b772-d29879e253b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.226150 May 11 21:05:29.889693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 56/109] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:29 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:30.152149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:30.153405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:30.159724 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.160168 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:30.160934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.161359 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:30.312688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:30.322057 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:30.323556 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:30.324665 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-336109b7-2358-4f9c-8136-43107bffc416 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.176419 May 11 21:05:30.336678 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 54/110] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:30 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:05:30.475962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:30.477155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:30.487018 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.487466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:30.488238 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.488668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:30.638393 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:30.639001 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:30.645542 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.646255 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:30.647015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.647449 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:30.692151 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:30.701254 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-408a100b-36e1-4d44-9c77-e6721867998e tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1501 microversion: 2.1 time: 0.231790 May 11 21:05:30.717165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 57/111] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:30 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1501 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:30.803546 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:30.811637 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bfb6bea0-2cbc-4362-9d45-d02e04300d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.176873 May 11 21:05:30.813153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 55/112] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:30 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:30.907665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:30.908703 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:30.915152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.915598 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:30.916367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:30.917002 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:31.120102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:31.130767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cb65249e-0e3f-4944-ba5e-875b76619865 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.228202 May 11 21:05:31.131748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 58/113] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:30 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:31.345553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:31.347121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:31.350998 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-29a42f69-ad5f-48be-956e-e51b85bfb8cd req-70406d95-4aa5-4e0f-8fc7-54ed943ec9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e6f4c2-0bcd-4a54-854f-638f98f48a25", "name": "network-vif-plugged", "status": "completed", "tag": "17516495-e3a1-4e3b-9f09-7e6a38573ceb"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:31.353950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:31.354935 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:31.355772 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:31.356349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:31.362215 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-29a42f69-ad5f-48be-956e-e51b85bfb8cd req-70406d95-4aa5-4e0f-8fc7-54ed943ec9f7 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:31.362758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-29a42f69-ad5f-48be-956e-e51b85bfb8cd req-70406d95-4aa5-4e0f-8fc7-54ed943ec9f7 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:31.375388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-29a42f69-ad5f-48be-956e-e51b85bfb8cd req-70406d95-4aa5-4e0f-8fc7-54ed943ec9f7 service nova] Creating event network-vif-plugged:17516495-e3a1-4e3b-9f09-7e6a38573ceb for instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 on hv-cinder-84146 May 11 21:05:31.381041 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-29a42f69-ad5f-48be-956e-e51b85bfb8cd req-70406d95-4aa5-4e0f-8fc7-54ed943ec9f7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036462 May 11 21:05:31.384047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 59/114] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:31.503825 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:31.512125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:31.513634 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:31.514749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a6d18b1b-a288-4767-8920-ab0a89cfc3b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.175399 May 11 21:05:31.515340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 56/115] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:31 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:31.833746 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:31.835641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:31.855464 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:31.856549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:31.858189 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:31.859068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:32.079300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:32.086939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-715f7f3c-4696-4773-a56a-5004707bdd13 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.257611 May 11 21:05:32.087504 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 60/116] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:31 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:32.148086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:32.148638 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:32.154549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:32.159213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:32.159213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:32.159213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:32.302200 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:32.309369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-60d94adb-ad1c-4a0a-a9a2-b88dd8cb3c59 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.165617 May 11 21:05:32.309954 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 57/117] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:32 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:32.532113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:32.532713 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:32.538695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:32.539265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:32.540032 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:32.540467 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:32.686735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:32.696371 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:32.698127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:32.699334 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c5dd7009-493b-4569-85e2-48f626de9729 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1406 microversion: 2.20 time: 0.171080 May 11 21:05:32.716928 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 61/118] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:32 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:32.962104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2f3b4ff3-e89b-42c8-9591-19206db05532 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a2e26e8-8de4-4214-917b-e668ae63e640"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:32.963240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2f3b4ff3-e89b-42c8-9591-19206db05532 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:32.969945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3b4ff3-e89b-42c8-9591-19206db05532 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:32.970388 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3b4ff3-e89b-42c8-9591-19206db05532 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:32.971204 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3b4ff3-e89b-42c8-9591-19206db05532 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:32.971631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f3b4ff3-e89b-42c8-9591-19206db05532 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.103978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:33.104730 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:33.112143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.112806 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.113929 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.114586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.262349 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:33.272473 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cf937fda-e088-4d01-9354-e5ccafc36a65 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.172453 May 11 21:05:33.284239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 62/119] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:33 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:33.333481 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:33.334284 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:33.341038 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.341493 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.342613 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.343719 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.513077 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:33.522740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9649752d-cc99-4e72-b820-6f4cc70fe820 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.199731 May 11 21:05:33.523945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 63/120] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:33 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:33.529627 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-80896151-1c36-4791-ba87-5a41281872fe req-2af0693e-eb63-439b-bde2-57bbd6714932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a0c714-2a75-4c5a-b97c-bd3407687b16", "name": "network-vif-plugged", "status": "completed", "tag": "b5d7d61f-ac27-420d-a3ea-7fdaecaeed05"}, {"server_uuid": "925e3d97-64b1-4637-9850-0c37d5f2a870", "name": "network-vif-plugged", "status": "completed", "tag": "5c51e32e-4186-43e2-9063-ee5936dea096"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:33.538119 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-80896151-1c36-4791-ba87-5a41281872fe req-2af0693e-eb63-439b-bde2-57bbd6714932 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.538558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-80896151-1c36-4791-ba87-5a41281872fe req-2af0693e-eb63-439b-bde2-57bbd6714932 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.552881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-80896151-1c36-4791-ba87-5a41281872fe req-2af0693e-eb63-439b-bde2-57bbd6714932 service nova] Creating event network-vif-plugged:b5d7d61f-ac27-420d-a3ea-7fdaecaeed05 for instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 on hv-cinder-84146 May 11 21:05:33.553388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-80896151-1c36-4791-ba87-5a41281872fe req-2af0693e-eb63-439b-bde2-57bbd6714932 service nova] Creating event network-vif-plugged:5c51e32e-4186-43e2-9063-ee5936dea096 for instance 925e3d97-64b1-4637-9850-0c37d5f2a870 on hv-cinder-84146 May 11 21:05:33.560229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-80896151-1c36-4791-ba87-5a41281872fe req-2af0693e-eb63-439b-bde2-57bbd6714932 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035105 May 11 21:05:33.560814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 64/121] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:33.725658 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:33.733254 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:33.734676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.735845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.736774 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.737349 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.869678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:33.897315 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:33.898822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:33.900165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-569f21ca-0310-4c83-b3bc-308fc6af157d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1598 microversion: 2.20 time: 0.180046 May 11 21:05:33.900526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 65/122] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:05:33 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:05:33.919919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-21701073-2515-4e90-b17a-64989d4ab0de tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:33.920569 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-21701073-2515-4e90-b17a-64989d4ab0de tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:33.927954 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21701073-2515-4e90-b17a-64989d4ab0de tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.928404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21701073-2515-4e90-b17a-64989d4ab0de tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:33.931306 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21701073-2515-4e90-b17a-64989d4ab0de tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:33.931306 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-21701073-2515-4e90-b17a-64989d4ab0de tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:34.085896 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-21701073-2515-4e90-b17a-64989d4ab0de tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.170653 May 11 21:05:34.086697 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 66/123] 10.222.0.35 () {60 vars in 1315 bytes} [Wed May 11 21:05:33 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 21:05:34.198523 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2f3b4ff3-e89b-42c8-9591-19206db05532 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "POST /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.240091 May 11 21:05:34.199999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 58/124] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:05:32 2022] POST /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd/os-volume_attachments => generated 194 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:34.290688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:34.291336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:34.297969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:34.298612 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:34.299544 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:34.299976 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:34.528424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:34.538670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-009e5a77-07b0-497e-9dfc-52b6a7f20029 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1363 microversion: 2.1 time: 0.251756 May 11 21:05:34.539549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 67/125] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:34 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:34.546866 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:34.547579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:34.555606 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:34.556066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:34.556887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:34.563601 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:34.897713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:34.914233 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-99e00865-7b92-4b50-a377-daa5e8dbd2ee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.372784 May 11 21:05:34.915176 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 59/126] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:34 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:35.556739 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:35.557359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:35.569045 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:35.569946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:35.570950 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:35.571577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:35.740139 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:35.750113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-302e5938-e6f8-4f11-b929-9468fd47ec7f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1549 microversion: 2.1 time: 0.197134 May 11 21:05:35.750751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 68/127] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:35 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1549 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:35.767123 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e5216b9b-4568-4a3e-91c3-93b3aa3f2469 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:35.767880 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e5216b9b-4568-4a3e-91c3-93b3aa3f2469 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:35.774922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5216b9b-4568-4a3e-91c3-93b3aa3f2469 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:35.775369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5216b9b-4568-4a3e-91c3-93b3aa3f2469 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:35.776158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5216b9b-4568-4a3e-91c3-93b3aa3f2469 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:35.776753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e5216b9b-4568-4a3e-91c3-93b3aa3f2469 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:35.883090 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e5216b9b-4568-4a3e-91c3-93b3aa3f2469 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119231 May 11 21:05:35.884122 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 60/128] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:05:35 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:35.895765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-d77d274e-c5f8-4f9d-b40b-292963a6baed req-5636d047-dc22-4f48-abbd-eeb323eb02ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e6f4c2-0bcd-4a54-854f-638f98f48a25", "tag": "17516495-e3a1-4e3b-9f09-7e6a38573ceb"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:35.906880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d77d274e-c5f8-4f9d-b40b-292963a6baed req-5636d047-dc22-4f48-abbd-eeb323eb02ad service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:35.907325 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d77d274e-c5f8-4f9d-b40b-292963a6baed req-5636d047-dc22-4f48-abbd-eeb323eb02ad service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:35.922600 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-d77d274e-c5f8-4f9d-b40b-292963a6baed req-5636d047-dc22-4f48-abbd-eeb323eb02ad service nova] Creating event network-changed:17516495-e3a1-4e3b-9f09-7e6a38573ceb for instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 on hv-cinder-84146 May 11 21:05:35.927612 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-d77d274e-c5f8-4f9d-b40b-292963a6baed req-5636d047-dc22-4f48-abbd-eeb323eb02ad service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035868 May 11 21:05:35.931959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 69/129] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:35.933241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:35.933870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:35.941404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:35.942162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:35.944098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:35.944974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:36.187699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:36.195045 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eec661fd-8898-4d81-926c-4da6836df687 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1365 microversion: 2.1 time: 0.267101 May 11 21:05:36.195636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 61/130] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:35 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:05:37.213141 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:37.213877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:37.231152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:37.234140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:37.234921 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:37.237272 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:37.443846 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:37.452403 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4b550b59-d5f1-4853-aeb1-e57a772849d5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1554 microversion: 2.1 time: 0.243328 May 11 21:05:37.463790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 70/131] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:37 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:37.475053 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-baf76a27-0bc6-469d-9dec-efdd49a0d106 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:37.475053 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-baf76a27-0bc6-469d-9dec-efdd49a0d106 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:37.478826 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-baf76a27-0bc6-469d-9dec-efdd49a0d106 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:37.479452 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-baf76a27-0bc6-469d-9dec-efdd49a0d106 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:37.480445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-baf76a27-0bc6-469d-9dec-efdd49a0d106 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:37.481093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-baf76a27-0bc6-469d-9dec-efdd49a0d106 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:37.581119 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-baf76a27-0bc6-469d-9dec-efdd49a0d106 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114869 May 11 21:05:37.582093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 62/132] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:05:37 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:38.225319 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-1bd78d99-16bd-48dd-9355-0f6afe2f7ba6 req-b496980a-c867-42c5-ae8f-b24603b028e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925e3d97-64b1-4637-9850-0c37d5f2a870", "tag": "5c51e32e-4186-43e2-9063-ee5936dea096"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:38.233356 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-1bd78d99-16bd-48dd-9355-0f6afe2f7ba6 req-b496980a-c867-42c5-ae8f-b24603b028e1 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:38.245522 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-1bd78d99-16bd-48dd-9355-0f6afe2f7ba6 req-b496980a-c867-42c5-ae8f-b24603b028e1 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:38.261114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-1bd78d99-16bd-48dd-9355-0f6afe2f7ba6 req-b496980a-c867-42c5-ae8f-b24603b028e1 service nova] Creating event network-changed:5c51e32e-4186-43e2-9063-ee5936dea096 for instance 925e3d97-64b1-4637-9850-0c37d5f2a870 on hv-cinder-84146 May 11 21:05:38.274149 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-1bd78d99-16bd-48dd-9355-0f6afe2f7ba6 req-b496980a-c867-42c5-ae8f-b24603b028e1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051454 May 11 21:05:38.275586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 71/133] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:39.129771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-d48e35fc-cb8c-4609-a3c6-59917afa4f86 req-9f5c0d74-2922-42f7-8dc9-375f62174a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a0c714-2a75-4c5a-b97c-bd3407687b16", "tag": "b5d7d61f-ac27-420d-a3ea-7fdaecaeed05"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:39.156062 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d48e35fc-cb8c-4609-a3c6-59917afa4f86 req-9f5c0d74-2922-42f7-8dc9-375f62174a85 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:39.159353 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d48e35fc-cb8c-4609-a3c6-59917afa4f86 req-9f5c0d74-2922-42f7-8dc9-375f62174a85 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:39.201445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-d48e35fc-cb8c-4609-a3c6-59917afa4f86 req-9f5c0d74-2922-42f7-8dc9-375f62174a85 service nova] Creating event network-changed:b5d7d61f-ac27-420d-a3ea-7fdaecaeed05 for instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 on hv-cinder-84146 May 11 21:05:39.215426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-d48e35fc-cb8c-4609-a3c6-59917afa4f86 req-9f5c0d74-2922-42f7-8dc9-375f62174a85 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090173 May 11 21:05:39.219197 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 63/134] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:45.503809 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:45.504578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:45.511658 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:45.512528 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:45.513405 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:45.513920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:45.549045 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:05:45.879900 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0c05df17-8fcf-4b4f-99a2-53c8920e6c25 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "DELETE /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 204 len: 0 microversion: 2.1 time: 0.380619 May 11 21:05:45.880488 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 72/135] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:05:45 2022] DELETE /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:05:45.888968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:45.890230 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:45.896937 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:45.897379 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:45.898166 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:45.898599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:46.025646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:46.034986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2f90dfc6-e2de-4cb9-9163-d76617ef2ff8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1553 microversion: 2.1 time: 0.150142 May 11 21:05:46.035550 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 64/136] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:45 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:47.052959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:47.061642 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:47.061642 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:47.061642 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:47.061642 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:47.062001 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:47.183991 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:47.192204 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4e68723d-da32-4042-8128-ba6588fdce1b tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1553 microversion: 2.1 time: 0.143414 May 11 21:05:47.192773 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 73/137] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:47 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:48.209421 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:48.210054 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:48.216382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:48.219564 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:48.219564 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:48.219564 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:48.349116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:48.357127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e9658e77-9faa-41a3-b71c-f96ee7df6d30 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1553 microversion: 2.1 time: 0.151625 May 11 21:05:48.357723 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 65/138] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:48 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:49.377362 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:49.378012 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:49.383839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:49.384286 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:49.385036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:49.385469 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:49.510488 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:49.518944 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8b17f2c4-ebcc-49d8-bb37-3bc66c4534ff tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1553 microversion: 2.1 time: 0.146038 May 11 21:05:49.519507 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 74/139] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:49 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:50.536034 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:50.536643 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:50.542973 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:50.543445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:50.544231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:50.544664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:50.670352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:50.678665 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a11f6ba8-bf38-4e69-9dcf-d7594d2b0c52 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1553 microversion: 2.1 time: 0.146536 May 11 21:05:50.679237 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 66/140] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:50 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:51.707157 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:51.710412 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:51.718787 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:51.720191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:51.721177 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:51.729046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:52.236923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:52.247278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d4194a8b-9131-4820-b949-1bf2057faaed tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1553 microversion: 2.1 time: 0.553338 May 11 21:05:52.257512 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 75/141] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:51 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1553 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:52.821498 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-0bf30733-f47a-4255-ab1d-a86e60c49d7e req-446f3b07-5f8b-4ad3-9a37-4f49db900ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c813c1-9c8c-4614-a5dc-a21b2a13cdcd", "name": "network-vif-deleted", "tag": "5f7e5f06-1d67-4fab-9fdc-7d34f9f7c9ab"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:05:52.834384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0bf30733-f47a-4255-ab1d-a86e60c49d7e req-446f3b07-5f8b-4ad3-9a37-4f49db900ee8 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:52.836747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0bf30733-f47a-4255-ab1d-a86e60c49d7e req-446f3b07-5f8b-4ad3-9a37-4f49db900ee8 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:52.855907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-0bf30733-f47a-4255-ab1d-a86e60c49d7e req-446f3b07-5f8b-4ad3-9a37-4f49db900ee8 service nova] Creating event network-vif-deleted:5f7e5f06-1d67-4fab-9fdc-7d34f9f7c9ab for instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd on hv-cinder-84146 May 11 21:05:52.863469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-0bf30733-f47a-4255-ab1d-a86e60c49d7e req-446f3b07-5f8b-4ad3-9a37-4f49db900ee8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045143 May 11 21:05:52.864457 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 67/142] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:05:53.264970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:53.265598 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:53.271671 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:53.272114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:53.272899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:53.273328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:53.348200 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:53.374156 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3ff61cc1-216d-42ad-b09a-ab3752b1c4a0 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1346 microversion: 2.1 time: 0.112992 May 11 21:05:53.381663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 76/143] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:53 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:54.400896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:54.402508 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:54.408651 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:54.409109 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:54.409920 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:54.410360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:54.449516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:54.450270 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:54.450962 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lazy-loading 'fault' on Instance uuid 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:05:54.529187 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ae8e6e3ec8401cbc7be32478ec7a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba603b859ac34a119a85b6eaef862098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:05:54.537515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-43f6955c-3b93-41aa-b2dc-e15a3ca22dc8 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 200 len: 1305 microversion: 2.1 time: 0.146529 May 11 21:05:54.538387 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 68/144] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:54 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:05:55.561192 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:55.562068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:55.570181 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:55.572823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:55.572823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:55.572823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:55.586780 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] HTTP exception thrown: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Request method failure captured: May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd HTTP/1.1 May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCTt1UPOP2UVR91mF1XKeDg-JXQBJJnp5D7hqwO6uvgCW3hbs5EkIS09BYyGk4dFe62zCNbNkGMG2seitmEWTfP3KfvqhsB1GwqnRAvC5g6YIY4vUFkp_IZsmr0Ju7SEwYww2JfBF5MUSI_6VF7VsJUoPY0EI0g6zmufh_QeiI3a7js May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:05:55.591765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ba603b859ac34a119a85b6eaef862098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-DeleteServersTestJSON-449462330 May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 70ae8e6e3ec8401cbc7be32478ec7a89 May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.593283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '46c813c1-9c8c-4614-a5dc-a21b2a13cdcd'} May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:05:55.594494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.595691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:55.596906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Returning 404 to user: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:05:55.596906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-191e2385-f571-4e17-9ca0-b937eedf198c tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 404 len: 111 microversion: 2.1 time: 0.036651 May 11 21:05:55.596906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 77/145] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:55 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:05:55.702719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:55.703707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:55.710716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:55.711350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:55.712071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:55.712512 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:55.725246 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] HTTP exception thrown: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Request method failure captured: May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd/os-volume_attachments HTTP/1.1 May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCTt1UPOP2UVR91mF1XKeDg-JXQBJJnp5D7hqwO6uvgCW3hbs5EkIS09BYyGk4dFe62zCNbNkGMG2seitmEWTfP3KfvqhsB1GwqnRAvC5g6YIY4vUFkp_IZsmr0Ju7SEwYww2JfBF5MUSI_6VF7VsJUoPY0EI0g6zmufh_QeiI3a7js May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:05:55.729828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ba603b859ac34a119a85b6eaef862098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-DeleteServersTestJSON-449462330 May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: 70ae8e6e3ec8401cbc7be32478ec7a89 May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.731282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'server_id': '46c813c1-9c8c-4614-a5dc-a21b2a13cdcd'} May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:05:55.735986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:55.737350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:55.738803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Returning 404 to user: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:05:55.738803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a93e15c7-77dd-4dd7-b1bb-c57ad9743cc2 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032717 May 11 21:05:55.738803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 69/146] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:05:55 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:05:57.146358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:57.146863 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:57.152617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:57.153059 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:57.153887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:57.154323 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:57.170508 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] HTTP exception thrown: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Request method failure captured: May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: DELETE /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd HTTP/1.1 May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCTt1UPOP2UVR91mF1XKeDg-JXQBJJnp5D7hqwO6uvgCW3hbs5EkIS09BYyGk4dFe62zCNbNkGMG2seitmEWTfP3KfvqhsB1GwqnRAvC5g6YIY4vUFkp_IZsmr0Ju7SEwYww2JfBF5MUSI_6VF7VsJUoPY0EI0g6zmufh_QeiI3a7js May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:05:57.172590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ba603b859ac34a119a85b6eaef862098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-DeleteServersTestJSON-449462330 May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 70ae8e6e3ec8401cbc7be32478ec7a89 May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.174185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '46c813c1-9c8c-4614-a5dc-a21b2a13cdcd'} May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:05:57.175183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.176239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:05:57.177360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Returning 404 to user: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:05:57.177360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-db6bb5e0-1d0e-4ef5-84d8-ab771dffa925 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "DELETE /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 404 len: 111 microversion: 2.1 time: 0.031779 May 11 21:05:57.177360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 78/147] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:05:57 2022] DELETE /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:05:57.182491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:05:57.183115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] [instance: 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:05:57.190762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:57.191232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:57.192236 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:05:57.192676 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:05:57.207510 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] HTTP exception thrown: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Request method failure captured: May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd HTTP/1.1 May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCTt1UPOP2UVR91mF1XKeDg-JXQBJJnp5D7hqwO6uvgCW3hbs5EkIS09BYyGk4dFe62zCNbNkGMG2seitmEWTfP3KfvqhsB1GwqnRAvC5g6YIY4vUFkp_IZsmr0Ju7SEwYww2JfBF5MUSI_6VF7VsJUoPY0EI0g6zmufh_QeiI3a7js May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:05:57.209714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ba603b859ac34a119a85b6eaef862098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ba603b859ac34a119a85b6eaef862098"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-DeleteServersTestJSON-449462330 May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ba603b859ac34a119a85b6eaef862098 May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-DeleteServersTestJSON-449462330 May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: 70ae8e6e3ec8401cbc7be32478ec7a89 May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-DeleteServersTestJSON-449462330-project May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.211212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '46c813c1-9c8c-4614-a5dc-a21b2a13cdcd'} May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:05:57.211868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. May 11 21:05:57.213042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:05:57.214033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] Returning 404 to user: Instance 46c813c1-9c8c-4614-a5dc-a21b2a13cdcd could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:05:57.214033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2650f831-9f97-493f-86ff-775329091854 tempest-DeleteServersTestJSON-449462330 tempest-DeleteServersTestJSON-449462330-project] 10.222.0.35 "GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd" status: 404 len: 111 microversion: 2.1 time: 0.032794 May 11 21:05:57.214033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 70/148] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:05:57 2022] GET /compute/v2.1/servers/46c813c1-9c8c-4614-a5dc-a21b2a13cdcd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:06:06.305982 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1526035235", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:06.360040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] validate_networks() for [('a9807f35-125b-48ae-9b3f-337b199ffd2c', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:06:06.786891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:06:06.797133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:06:06.797133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:06:06.797133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:06:06.797133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:06:06.799965 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:06.800296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:06.802951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:06.802951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:06.837467 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for project 838ec035db164e50bc335d2cf141d943. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:06:06.842353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for user df9d6a9b73e64e31b014b5809912bbe8 and project 838ec035db164e50bc335d2cf141d943. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:06:06.859952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:06:06.860876 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:06:07.040589 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a1013f4b-fb61-4caa-973c-52afc5db1eff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.856922 May 11 21:06:07.045880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 79/149] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:06:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:06:07.051531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2b40d251-d237-42c6-8d61-50f7ca74d9f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:07.052143 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2b40d251-d237-42c6-8d61-50f7ca74d9f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:07.110967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2b40d251-d237-42c6-8d61-50f7ca74d9f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:07.119650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2b40d251-d237-42c6-8d61-50f7ca74d9f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1222 microversion: 2.1 time: 0.071938 May 11 21:06:07.120213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 71/150] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:07 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:07.258497 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1725336064", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:07.310512 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] validate_networks() for [('a9807f35-125b-48ae-9b3f-337b199ffd2c', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:06:07.704751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:06:07.705427 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:06:07.706040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:06:07.706724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:06:07.707404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:06:07.718936 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:07.719749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:07.721131 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:07.721974 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:07.750790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for project 838ec035db164e50bc335d2cf141d943. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:06:07.758555 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for user df9d6a9b73e64e31b014b5809912bbe8 and project 838ec035db164e50bc335d2cf141d943. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:06:07.778978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:06:07.783811 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:06:07.996799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9fe5aae0-c67a-4d4a-adbf-1e88c154778c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.732366 May 11 21:06:07.996799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 80/151] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:06:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:06:07.997074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6ad6c77c-335a-4b97-af76-4255a9b155c5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:07.997074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6ad6c77c-335a-4b97-af76-4255a9b155c5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:08.053997 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6ad6c77c-335a-4b97-af76-4255a9b155c5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:08.061843 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6ad6c77c-335a-4b97-af76-4255a9b155c5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1222 microversion: 2.1 time: 0.069512 May 11 21:06:08.062434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 72/152] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:07 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:09.079988 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:09.080650 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:09.088808 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:09.089152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:09.089955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:09.090409 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:09.163559 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:09.171129 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-859a34f8-4ee2-4fe8-b44d-2292c6d3a3bf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1226 microversion: 2.1 time: 0.096036 May 11 21:06:09.171799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 81/153] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:09 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:10.189203 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:10.190006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:10.198561 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:10.198561 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:10.198788 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:10.199167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:10.280438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:10.290087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e4d49c2e-8743-4716-8c52-165faf3c28cb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1274 microversion: 2.1 time: 0.105596 May 11 21:06:10.290856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 73/154] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:10 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:11.309980 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:11.318827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:11.340718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:11.341179 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:11.342119 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:11.342550 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:11.485948 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:11.486648 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-372dd8c0-f06e-45c0-bb58-8769f9ec062f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1292 microversion: 2.1 time: 0.180765 May 11 21:06:11.487215 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 82/155] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:11 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:12.290599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-0df95ce6-d5ce-46a4-8a48-7dadc5291cca req-aeb65b1f-f293-4b39-81b2-8afbedb11d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b", "tag": "bcd2a37c-3573-4057-b264-754141dbb9d2"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:12.302730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0df95ce6-d5ce-46a4-8a48-7dadc5291cca req-aeb65b1f-f293-4b39-81b2-8afbedb11d51 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:12.303174 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0df95ce6-d5ce-46a4-8a48-7dadc5291cca req-aeb65b1f-f293-4b39-81b2-8afbedb11d51 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:12.314806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-0df95ce6-d5ce-46a4-8a48-7dadc5291cca req-aeb65b1f-f293-4b39-81b2-8afbedb11d51 service nova] Creating event network-changed:bcd2a37c-3573-4057-b264-754141dbb9d2 for instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b on hv-cinder-84146 May 11 21:06:12.320318 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-0df95ce6-d5ce-46a4-8a48-7dadc5291cca req-aeb65b1f-f293-4b39-81b2-8afbedb11d51 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033834 May 11 21:06:12.321280 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 74/156] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:12.511743 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:12.516934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:12.531375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:12.532083 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:12.534017 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:12.534742 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:12.950710 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:12.958351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e6bc845a-d5b2-49ea-84db-2eecf99f61e9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.457126 May 11 21:06:12.958960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 83/157] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:12 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:13.977057 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:13.978763 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:13.986890 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:13.988269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:13.989218 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:13.990383 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:14.502592 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:14.646761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-68faef80-0277-4724-bd9d-df38238d45a3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.537750 May 11 21:06:14.646761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 75/158] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:13 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:14.872376 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-c61f6e2d-1469-4115-8ee2-0ae9f013f202 req-fac05624-4a50-4057-b03e-f62775ac7308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b17946c-9b29-4cf0-b62d-4037ebde79b1", "tag": "054cb2d8-9dcc-48fd-a1bf-bf3aaea65572"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:14.908973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c61f6e2d-1469-4115-8ee2-0ae9f013f202 req-fac05624-4a50-4057-b03e-f62775ac7308 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:14.909411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-c61f6e2d-1469-4115-8ee2-0ae9f013f202 req-fac05624-4a50-4057-b03e-f62775ac7308 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:14.932781 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-c61f6e2d-1469-4115-8ee2-0ae9f013f202 req-fac05624-4a50-4057-b03e-f62775ac7308 service nova] Creating event network-changed:054cb2d8-9dcc-48fd-a1bf-bf3aaea65572 for instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 on hv-cinder-84146 May 11 21:06:14.938234 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-c61f6e2d-1469-4115-8ee2-0ae9f013f202 req-fac05624-4a50-4057-b03e-f62775ac7308 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069437 May 11 21:06:14.939146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 84/159] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:15.656825 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:15.658158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:15.667559 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:15.670222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:15.674491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:15.675008 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:15.898487 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:15.908704 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5c8fb80b-bdf5-419e-9c67-994375c16772 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.256342 May 11 21:06:15.909747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 76/160] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:15 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:16.926626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:16.928048 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:16.938081 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:16.940511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:16.943236 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:16.947978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:17.191345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:17.204789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c45a1473-302a-4133-b324-cc526f7965d4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.282019 May 11 21:06:17.209387 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 85/161] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:16 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:18.222162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:18.222674 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:18.228922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:18.232443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:18.233835 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:18.237950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:18.372608 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:18.380729 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3e192579-625d-471e-81ea-0a31fe9dd0ac tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.162781 May 11 21:06:18.384743 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 77/162] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:18 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:18.691721 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-068f703d-5d9b-493a-bab7-e6bcbe90d1c5 req-6478e3be-550c-4d40-bcb7-5ab2665f2d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b", "name": "network-vif-plugged", "status": "completed", "tag": "bcd2a37c-3573-4057-b264-754141dbb9d2"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:18.717294 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-068f703d-5d9b-493a-bab7-e6bcbe90d1c5 req-6478e3be-550c-4d40-bcb7-5ab2665f2d59 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:18.718266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-068f703d-5d9b-493a-bab7-e6bcbe90d1c5 req-6478e3be-550c-4d40-bcb7-5ab2665f2d59 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:18.738392 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-068f703d-5d9b-493a-bab7-e6bcbe90d1c5 req-6478e3be-550c-4d40-bcb7-5ab2665f2d59 service nova] Creating event network-vif-plugged:bcd2a37c-3573-4057-b264-754141dbb9d2 for instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b on hv-cinder-84146 May 11 21:06:18.743165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-068f703d-5d9b-493a-bab7-e6bcbe90d1c5 req-6478e3be-550c-4d40-bcb7-5ab2665f2d59 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055115 May 11 21:06:18.743893 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 86/163] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:06:19.397519 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:19.398160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:19.404221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:19.404671 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:19.405653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:19.406093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:19.550511 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:19.558149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c16d5e93-d87f-4a95-8baa-58641e97deb0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.165039 May 11 21:06:19.558716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 78/164] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:19 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:19.769387 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1029226762", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "networks": [{"uuid": "ed3efa9c-f23b-412c-a6d2-b3886e3eb354"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:19.821620 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] validate_networks() for [('ed3efa9c-f23b-412c-a6d2-b3886e3eb354', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:06:20.182962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:06:20.183378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:06:20.183842 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:06:20.184243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:06:20.184648 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:06:20.193842 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:20.194285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:20.195080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:20.195516 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:20.211583 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Getting quotas for project 98ca4d11f5b5459a93b0f97cbfcdc3a2. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:06:20.215441 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Getting quotas for user 74d61067c8034b6cb80bec103bc404a0 and project 98ca4d11f5b5459a93b0f97cbfcdc3a2. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:06:20.226914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:06:20.232633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:06:20.414760 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8d86828-e7df-406d-b7a8-8ba36bd4c576 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649479 May 11 21:06:20.420585 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 87/165] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:06:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:06:20.425513 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-022d56d0-be37-4a99-bfcb-1589b7728a43 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:20.426136 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-022d56d0-be37-4a99-bfcb-1589b7728a43 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:20.505854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-022d56d0-be37-4a99-bfcb-1589b7728a43 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:20.512969 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-022d56d0-be37-4a99-bfcb-1589b7728a43 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1214 microversion: 2.1 time: 0.091177 May 11 21:06:20.513668 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 79/166] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:20 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:20.575570 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:20.576172 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:20.584228 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:20.584577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:20.585338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:20.585793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:20.725793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:20.733111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c8b8c518-bc7c-4f29-911a-f315bbc266a7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.161383 May 11 21:06:20.733696 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 88/167] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:20 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:21.159861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-956b13a4-bee1-453b-bcf3-3c316d9e9534 req-61527cb7-9bcf-4a57-b802-94fc21a9cfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b17946c-9b29-4cf0-b62d-4037ebde79b1", "name": "network-vif-plugged", "status": "completed", "tag": "054cb2d8-9dcc-48fd-a1bf-bf3aaea65572"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:21.168563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-956b13a4-bee1-453b-bcf3-3c316d9e9534 req-61527cb7-9bcf-4a57-b802-94fc21a9cfb0 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:21.169006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-956b13a4-bee1-453b-bcf3-3c316d9e9534 req-61527cb7-9bcf-4a57-b802-94fc21a9cfb0 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:21.179896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-956b13a4-bee1-453b-bcf3-3c316d9e9534 req-61527cb7-9bcf-4a57-b802-94fc21a9cfb0 service nova] Creating event network-vif-plugged:054cb2d8-9dcc-48fd-a1bf-bf3aaea65572 for instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 on hv-cinder-84146 May 11 21:06:21.185179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-956b13a4-bee1-453b-bcf3-3c316d9e9534 req-61527cb7-9bcf-4a57-b802-94fc21a9cfb0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029393 May 11 21:06:21.185875 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 80/168] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:21.531122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0235c6ff-d3a2-403e-80ae-03bf0f33bdf4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:21.531708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0235c6ff-d3a2-403e-80ae-03bf0f33bdf4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:21.581802 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0235c6ff-d3a2-403e-80ae-03bf0f33bdf4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:21.588274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0235c6ff-d3a2-403e-80ae-03bf0f33bdf4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1214 microversion: 2.1 time: 0.061474 May 11 21:06:21.588874 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 89/169] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:21 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:21.750289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:21.750997 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:21.757583 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:21.758042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:21.758814 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:21.759252 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:21.894011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:21.901832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bcf41c07-2e9a-436c-a3eb-4bff32be19c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.155785 May 11 21:06:21.902410 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 81/170] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:21 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:22.605412 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:22.606063 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:22.611945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:22.612401 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:22.613165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:22.613635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:22.672669 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:22.679841 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-49c86eb1-68c7-4593-9720-8b8f9c509122 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1218 microversion: 2.1 time: 0.078362 May 11 21:06:22.680408 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 90/171] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:22 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:22.919319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:22.919916 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:22.926888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:22.927339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:22.928112 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:22.928539 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:23.059457 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:23.067223 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-06643da5-5924-4eac-b789-a709a117fb1b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.151822 May 11 21:06:23.067787 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 82/172] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:22 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:23.696015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:23.696626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:23.703262 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:23.703706 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:23.704481 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:23.704913 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:23.766044 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:23.775218 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4a5a0c79-e229-41a9-8a6d-966390b5fb41 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1210 microversion: 2.1 time: 0.082976 May 11 21:06:23.776001 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 91/173] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:23 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:24.085465 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:24.086236 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:24.093460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:24.093930 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:24.094691 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:24.095114 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:24.237749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:24.245516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-aeedf5cf-c331-4bd3-a0a4-0ed372927ea9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.165156 May 11 21:06:24.253070 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 83/174] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:24 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:24.792424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:24.793064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:24.798865 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:24.799297 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:24.800054 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:24.800487 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:24.861770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:24.868979 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-53998716-3ff1-4911-8a1d-98a7c29da639 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1266 microversion: 2.1 time: 0.080385 May 11 21:06:24.869555 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 92/175] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:24 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:25.263215 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:25.264600 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:25.272701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:25.273761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:25.275229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:25.277993 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:25.410993 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:25.418298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d8f433fe-cc94-4b91-975c-223f342f7eca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1322 microversion: 2.1 time: 0.159189 May 11 21:06:25.418883 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 84/176] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:25 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:25.523845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ac74fef8-7b9d-4993-a039-f29498a9434a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:25.524740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ac74fef8-7b9d-4993-a039-f29498a9434a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:25.531169 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac74fef8-7b9d-4993-a039-f29498a9434a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:25.531608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac74fef8-7b9d-4993-a039-f29498a9434a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:25.532355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac74fef8-7b9d-4993-a039-f29498a9434a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:25.532854 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac74fef8-7b9d-4993-a039-f29498a9434a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:25.555862 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ac74fef8-7b9d-4993-a039-f29498a9434a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/ips" status: 200 len: 145 microversion: 2.1 time: 0.036060 May 11 21:06:25.556419 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 93/177] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:06:25 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:25.886293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:25.886942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:25.893423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:25.893890 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:25.900125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:25.900125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:25.964500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:25.972530 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-41f55076-a203-421d-9935-3691fa7d9567 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1274 microversion: 2.1 time: 0.090627 May 11 21:06:25.973098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 85/178] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:25 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:26.173659 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-65062a4d-9e74-42e8-82fe-600754470c7b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:26.174203 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65062a4d-9e74-42e8-82fe-600754470c7b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:26.180237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65062a4d-9e74-42e8-82fe-600754470c7b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:26.180680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65062a4d-9e74-42e8-82fe-600754470c7b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:26.181444 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65062a4d-9e74-42e8-82fe-600754470c7b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:26.181900 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65062a4d-9e74-42e8-82fe-600754470c7b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:26.213155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-65062a4d-9e74-42e8-82fe-600754470c7b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/ips" status: 200 len: 147 microversion: 2.1 time: 0.041890 May 11 21:06:26.218360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 94/179] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:06:26 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:26.438762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:26.439376 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:26.445850 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:26.446303 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:26.447101 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:26.447509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:26.586896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:26.595138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0850d020-1335-41bd-a712-23d0fc1f1b89 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1515 microversion: 2.1 time: 0.162875 May 11 21:06:26.595949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 86/180] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:26 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:26.611655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:26.612646 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:26.618455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:26.618888 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:26.619641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:26.620074 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:26.643592 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lazy-loading 'flavor' on Instance uuid 8b17946c-9b29-4cf0-b62d-4037ebde79b1 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:06:26.999816 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:27.001869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:27.009165 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:27.009777 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:27.010631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:27.011155 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:27.101879 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cbba02c7-9fb8-41fb-8d15-66b943112848 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1/action" status: 200 len: 32 microversion: 2.1 time: 0.494018 May 11 21:06:27.106611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 95/181] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:06:26 2022] POST /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1/action => generated 32 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:06:27.115776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:27.117197 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:27.126335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:27.127118 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:27.128033 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:27.128577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:27.286567 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:27.294576 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f9307610-462f-49cf-ac2f-0f8256a01b95 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.308784 May 11 21:06:27.295327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 87/182] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:26 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:27.500767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:27.509790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d268ead0-5599-47a5-bc05-6b271006e0ba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.398664 May 11 21:06:27.519429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 96/183] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:27 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:28.052512 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-acb528fb-1c66-47dd-bf40-f16319d471fe tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a56b471a-e4d9-4f15-9ccf-d3d313e6754f"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:28.053612 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-acb528fb-1c66-47dd-bf40-f16319d471fe tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:28.059771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acb528fb-1c66-47dd-bf40-f16319d471fe tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:28.060217 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acb528fb-1c66-47dd-bf40-f16319d471fe tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:28.060979 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acb528fb-1c66-47dd-bf40-f16319d471fe tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:28.061420 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-acb528fb-1c66-47dd-bf40-f16319d471fe tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:28.313292 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:28.314030 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:28.322551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:28.322551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:28.322551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:28.322551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:28.580187 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:28.584423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9d30da95-419a-4444-bdd5-493719fb76c8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.275086 May 11 21:06:28.593665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 97/184] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:28 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:28.601565 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:28.604823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:28.611150 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:28.611901 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:28.613814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:28.614333 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:28.877128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:28.884860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-90927da1-af69-4310-8b4f-f6c64c0f5524 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.289756 May 11 21:06:28.885431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 98/185] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:28 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:28.890010 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-fd257ff0-c12d-4ef1-aad5-a4cdbc99e4e3 req-ff36a8be-0fbc-4949-be79-068353a2308d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f429e01f-413f-41bc-baf7-e72ed484c480", "tag": "ea81f8a9-7d42-4c3a-be19-8273b87c62ea"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:28.897716 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fd257ff0-c12d-4ef1-aad5-a4cdbc99e4e3 req-ff36a8be-0fbc-4949-be79-068353a2308d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:28.898158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fd257ff0-c12d-4ef1-aad5-a4cdbc99e4e3 req-ff36a8be-0fbc-4949-be79-068353a2308d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:28.908830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-fd257ff0-c12d-4ef1-aad5-a4cdbc99e4e3 req-ff36a8be-0fbc-4949-be79-068353a2308d service nova] Creating event network-changed:ea81f8a9-7d42-4c3a-be19-8273b87c62ea for instance f429e01f-413f-41bc-baf7-e72ed484c480 on hv-cinder-84146 May 11 21:06:28.913748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-fd257ff0-c12d-4ef1-aad5-a4cdbc99e4e3 req-ff36a8be-0fbc-4949-be79-068353a2308d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026894 May 11 21:06:28.914430 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 99/186] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:29.114873 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-acb528fb-1c66-47dd-bf40-f16319d471fe tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.065975 May 11 21:06:29.122059 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 88/187] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:06:28 2022] POST /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments => generated 194 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:29.610191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:29.610191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:29.613461 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:29.613940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:29.614695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:29.615125 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:29.756679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:29.763985 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4357993b-c217-421a-858e-a2cbdeef3b10 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.162011 May 11 21:06:29.764665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 100/188] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:29 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:29.905981 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:29.906676 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:29.912659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:29.913128 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:29.913912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:29.914336 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:30.079728 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:30.087489 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7be2b266-f7ad-45fc-8991-023337a614a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.189453 May 11 21:06:30.088067 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 89/189] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:29 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:30.781978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:30.782592 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:30.788834 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:30.789287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:30.790181 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:30.790693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:30.832936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a6801e93-5e86-4c55-8ab2-23e0f4aba694 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb4215eb-fd86-4649-a722-d235ac25fe1c"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:30.838839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a6801e93-5e86-4c55-8ab2-23e0f4aba694 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:30.845073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6801e93-5e86-4c55-8ab2-23e0f4aba694 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:30.845517 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6801e93-5e86-4c55-8ab2-23e0f4aba694 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:30.846307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6801e93-5e86-4c55-8ab2-23e0f4aba694 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:30.846782 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a6801e93-5e86-4c55-8ab2-23e0f4aba694 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:30.945953 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:30.957044 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8c94a0dd-3de2-4433-896d-9e9e725aac98 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.175811 May 11 21:06:30.957877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 101/190] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:30 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:31.103891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:31.104571 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:31.111094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:31.111765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:31.112546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:31.112967 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:31.394350 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:31.401688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8b0d67dd-bb48-4745-b636-e5b42911da0a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.301632 May 11 21:06:31.402299 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 102/191] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:31 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:31.747692 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a6801e93-5e86-4c55-8ab2-23e0f4aba694 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.919078 May 11 21:06:31.748291 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 90/192] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:06:30 2022] POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:06:31.936407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1ee96321-7b9d-4b5d-acaf-ccc13ecae25d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:31.936926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1ee96321-7b9d-4b5d-acaf-ccc13ecae25d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:31.943045 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ee96321-7b9d-4b5d-acaf-ccc13ecae25d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:31.943489 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ee96321-7b9d-4b5d-acaf-ccc13ecae25d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:31.944239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ee96321-7b9d-4b5d-acaf-ccc13ecae25d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:31.944669 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ee96321-7b9d-4b5d-acaf-ccc13ecae25d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:31.968844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1ee96321-7b9d-4b5d-acaf-ccc13ecae25d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/ips" status: 200 len: 152 microversion: 2.20 time: 0.036129 May 11 21:06:31.971277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 103/193] 10.222.0.35 () {60 vars in 1288 bytes} [Wed May 11 21:06:31 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 21:06:31.974917 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:31.975610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:31.981858 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:31.982633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:31.983403 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:31.983841 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:32.116094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:32.123265 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-458c3577-7102-439d-bfc5-b26b5e332ea3 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.152523 May 11 21:06:32.123829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 91/194] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:31 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:32.420275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:32.421335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:32.428963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:32.429553 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:32.430590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:32.431120 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:32.572226 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:32.579458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fa743bed-e61a-4f53-8eea-41df5290651e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.163732 May 11 21:06:32.580041 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 104/195] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:32 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:33.140308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:33.141853 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:33.148763 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:33.149201 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:33.149991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:33.150412 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:33.273059 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:33.280227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cf7d1fda-6af6-49a5-83b3-47f073997f64 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.143945 May 11 21:06:33.280818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 92/196] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:33 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:33.596329 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:33.596939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:33.602735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:33.603183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:33.603942 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:33.604372 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:33.732306 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:33.740050 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f2e16efd-423e-4651-bbd8-d6d4490a48f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.147763 May 11 21:06:33.740638 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 105/197] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:33 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:34.298520 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:34.299119 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:34.305460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:34.305934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:34.306711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:34.307140 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:34.329396 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:34.329959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:34.335654 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:34.336097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:34.336850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:34.337279 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:34.360639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lazy-loading 'flavor' on Instance uuid b1e6f4c2-0bcd-4a54-854f-638f98f48a25 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:06:34.442007 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:34.449249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5859b263-2669-47b5-ae88-8bb5d30ea485 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.155446 May 11 21:06:34.449863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 93/198] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:34 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:34.671954 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-028b7f23-e0f8-4566-8354-1970c9d1a741 req-6c1eabb6-8de8-4176-97b7-f37460c55d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f429e01f-413f-41bc-baf7-e72ed484c480", "name": "network-vif-plugged", "status": "completed", "tag": "ea81f8a9-7d42-4c3a-be19-8273b87c62ea"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:34.679778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-028b7f23-e0f8-4566-8354-1970c9d1a741 req-6c1eabb6-8de8-4176-97b7-f37460c55d0b service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:34.680223 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-028b7f23-e0f8-4566-8354-1970c9d1a741 req-6c1eabb6-8de8-4176-97b7-f37460c55d0b service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:34.690831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-028b7f23-e0f8-4566-8354-1970c9d1a741 req-6c1eabb6-8de8-4176-97b7-f37460c55d0b service nova] Creating event network-vif-plugged:ea81f8a9-7d42-4c3a-be19-8273b87c62ea for instance f429e01f-413f-41bc-baf7-e72ed484c480 on hv-cinder-84146 May 11 21:06:34.697249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-028b7f23-e0f8-4566-8354-1970c9d1a741 req-6c1eabb6-8de8-4176-97b7-f37460c55d0b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028940 May 11 21:06:34.697875 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 94/199] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:06:34.756489 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:34.757187 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:34.763276 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:34.763722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:34.764475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:34.764905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:34.928434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:34.935752 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4bb2d096-ddfc-4635-9e29-2077f7621735 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.183404 May 11 21:06:34.936326 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 95/200] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:34 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:35.013111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6490d5d3-0321-496b-b3a3-515b0210f957 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/action" status: 202 len: 0 microversion: 2.20 time: 0.687277 May 11 21:06:35.017440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 106/201] 10.222.0.35 () {62 vars in 1318 bytes} [Wed May 11 21:06:34 2022] POST /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 11 21:06:35.023178 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:35.023833 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:35.029834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:35.030290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:35.031098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:35.031655 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:35.167557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:35.176196 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:35.177720 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:35.178869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e51c84e4-6632-43d3-9d5a-a81440f7c0e7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.159942 May 11 21:06:35.179423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 96/202] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:35 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:35.467000 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:35.467619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:35.474475 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:35.474940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:35.475707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:35.476197 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:35.602662 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:35.610892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7bc384ef-bfd9-488a-92a6-eeeb6b7ba2ca tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.148310 May 11 21:06:35.611550 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 107/203] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:35 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:35.952614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:35.953223 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:35.959514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:35.959962 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:35.960716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:35.961150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:36.094642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:36.102005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cae5dc97-d4cb-4fd1-9184-6137e58eea92 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.153161 May 11 21:06:36.102581 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 97/204] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:35 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:36.198466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:36.199073 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:36.205647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:36.206106 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:36.206906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:36.207345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:36.337156 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:36.345493 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:36.347001 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:36.348145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d60d0bda-866d-4ecd-a8f0-24dcf0251fb7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.153884 May 11 21:06:36.348699 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 108/205] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:36 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:36.627357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:36.628143 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:36.640244 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:36.640942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:36.641991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:36.642613 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:36.787177 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:36.794868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c948dd54-e7c7-4ea6-af5f-87a04ae3de77 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1314 microversion: 2.1 time: 0.171870 May 11 21:06:36.795448 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 98/206] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:36 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:37.127576 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:37.127576 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:37.131030 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:37.131617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:37.132449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:37.132880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:37.271743 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:37.281486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-65f0ce99-f066-4661-aa66-f315aaffb14a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.166060 May 11 21:06:37.282087 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 109/207] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:37 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:37.366857 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:37.367390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:37.373634 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:37.374082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:37.374837 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:37.375269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:37.508343 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:37.516221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:37.517873 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:37.519019 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1db89aad-d655-4d7f-a963-010a380686fb tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.156189 May 11 21:06:37.519575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 99/208] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:37 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:37.812094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:37.812696 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:37.818456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:37.818899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:37.819655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:37.820087 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:37.955586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:37.962933 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fdafd158-f11f-469a-be69-8dd9dcad6d72 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1499 microversion: 2.1 time: 0.154800 May 11 21:06:37.963482 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 110/209] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:37 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:38.298827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:38.299485 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:38.305176 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:38.305653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:38.306413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:38.306887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:38.441016 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:38.448417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b0f0413c-8ece-40a7-8472-7c3964ad37fb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.153533 May 11 21:06:38.448971 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 100/210] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:38 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:38.537514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:38.538136 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:38.544527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:38.547093 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:38.547093 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:38.547093 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:38.695823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:38.705388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:38.706938 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:38.708307 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-aed468a7-e4c2-4187-b578-976788fd984e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.174698 May 11 21:06:38.708929 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 111/211] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:38 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:39.088647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:39.089129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:39.095708 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.096322 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.097235 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.097695 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.122469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:06:39.134698 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e6ed4136-9fb9-4bb4-9168-2dfee7ad2d05 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: .version_select at 0x7ff898429a60>, body: {"keypair": {"name": "tempest-keypair-1136735027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHR+w64e50bRX7DQR4tAnJm5b684VUBs20/e0AafZwDc3InO5uXht1oeirEo02VEfx0CELmIL0WrnLEuti5SILqj4I7WlibB0jT98FfBLCtEFzrPRdkm3eIx/AuGDXNrBg=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:39.148803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-e6ed4136-9fb9-4bb4-9168-2dfee7ad2d05 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:06:39.152498 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-e6ed4136-9fb9-4bb4-9168-2dfee7ad2d05 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:06:39.285769 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e6ed4136-9fb9-4bb4-9168-2dfee7ad2d05 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154684 May 11 21:06:39.286366 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 112/212] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:06:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:06:39.464036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:39.464639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:39.471130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.471578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.472409 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.472774 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.501660 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3495e8f8-6e15-4cf4-b6f9-0057d5fc406b tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 204 len: 0 microversion: 2.1 time: 0.416153 May 11 21:06:39.503467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 101/213] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:06:39 2022] DELETE /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 21:06:39.513385 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:39.514128 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:39.521068 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.521544 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.522331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.522765 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.643245 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:39.653274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ff75e748-8565-42f1-813c-ef18285ee092 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.193073 May 11 21:06:39.654731 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 113/214] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:39 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:39.679928 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:39.689062 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-79821cea-df4f-4b4b-88b1-2840a05b18ab tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1505 microversion: 2.1 time: 0.179654 May 11 21:06:39.689653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 102/215] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:39 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:39.726314 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:39.726940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:39.732711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.733156 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.733945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:39.734377 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:39.867797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:39.875822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:39.877871 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:39.879037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cc990ec0-6068-45ea-adc8-03f5648d35ac tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.156575 May 11 21:06:39.879591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 114/216] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:39 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:40.670391 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:40.671207 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:40.679751 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:40.680511 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:40.682441 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:40.683098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:40.708718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:40.710160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:40.729903 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:40.730709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:40.731512 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:40.733995 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:40.979116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:40.991565 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-28095cea-68ab-4706-a6a4-b72d15de7770 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.325104 May 11 21:06:40.992153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 103/217] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:40 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:41.003831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:41.004860 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:41.006239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:41.011220 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:41.011764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:41.012525 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:41.012905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:41.019192 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-27eead8b-e40d-4057-ab17-3d6952b2a974 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1505 microversion: 2.1 time: 0.315903 May 11 21:06:41.020140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 115/218] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:40 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:41.149656 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:41.157706 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:41.159158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:41.160327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4e80d191-5b2f-413d-9860-7b22bc0b3a2f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.167280 May 11 21:06:41.160894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 104/219] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:40 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:41.864844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-b78f25fb-d53c-448c-9769-86d8559a5e6f req-ac3ea1de-c82c-49ba-91d1-79143bf87034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f429e01f-413f-41bc-baf7-e72ed484c480", "name": "network-vif-deleted", "tag": "ea81f8a9-7d42-4c3a-be19-8273b87c62ea"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:41.873370 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-b78f25fb-d53c-448c-9769-86d8559a5e6f req-ac3ea1de-c82c-49ba-91d1-79143bf87034 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:41.873938 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-b78f25fb-d53c-448c-9769-86d8559a5e6f req-ac3ea1de-c82c-49ba-91d1-79143bf87034 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:41.885002 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-b78f25fb-d53c-448c-9769-86d8559a5e6f req-ac3ea1de-c82c-49ba-91d1-79143bf87034 service nova] Creating event network-vif-deleted:ea81f8a9-7d42-4c3a-be19-8273b87c62ea for instance f429e01f-413f-41bc-baf7-e72ed484c480 on hv-cinder-84146 May 11 21:06:41.890032 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-b78f25fb-d53c-448c-9769-86d8559a5e6f req-ac3ea1de-c82c-49ba-91d1-79143bf87034 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030675 May 11 21:06:41.890617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 116/220] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:42.008816 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:42.009422 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:42.015710 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.016161 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.016923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.017361 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.039115 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:42.052455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:42.052455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.052455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.052455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.053028 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.150718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:42.160448 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-eef326bc-ef0a-4ac6-be33-5f392f01d221 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1463 microversion: 2.1 time: 0.125869 May 11 21:06:42.161030 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 117/221] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:42 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1463 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:42.178358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:42.181001 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:42.185443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.185927 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.186767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.187245 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.219214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:42.228094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4c047346-e55a-4539-b13e-cb6b6ffd4e4e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.222987 May 11 21:06:42.229124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 105/222] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:42 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:42.331041 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:42.340891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:42.342671 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:42.344031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0cb9532e-03da-4c53-8643-6aed9eee8621 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.169565 May 11 21:06:42.344620 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 118/223] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:42 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:42.385450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-762003223", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d70e35-28da-4d4e-9ed9-625e30aef3e3"}], "security_groups": [{"name": "tempest-securitygroup--1926818683"}], "key_name": "tempest-keypair-1136735027", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:42.484726 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] validate_networks() for [('93d70e35-28da-4d4e-9ed9-625e30aef3e3', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:06:42.847736 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:06:42.848161 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:06:42.848635 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:06:42.849044 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:06:42.849456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:06:42.858074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.858524 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.859327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:42.859764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:42.876409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:06:42.880286 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:06:42.891915 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:06:42.894243 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:06:42.996322 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d5ba2816-d8d9-4c49-a524-8e69d11e484b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614985 May 11 21:06:42.996970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 106/224] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:06:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:06:43.006801 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e5c89058-5f59-4479-92cb-54f83da85b9c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:43.007415 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e5c89058-5f59-4479-92cb-54f83da85b9c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:43.074875 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e5c89058-5f59-4479-92cb-54f83da85b9c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:43.082106 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e5c89058-5f59-4479-92cb-54f83da85b9c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1241 microversion: 2.1 time: 0.079073 May 11 21:06:43.082683 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 119/225] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:43 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:43.177126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:43.177767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:43.184391 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:43.184846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:43.185714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:43.186157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:43.245915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:43.246367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:43.246731 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:43.253504 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:43.254080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:43.254363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f83f223d-79c9-49f6-bdf9-b379fe5b6a93 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.081518 May 11 21:06:43.254858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:43.254966 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 107/226] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:43 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:43.255298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:43.362432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:43.363126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:43.368958 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:43.369503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:43.370272 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:43.370696 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:43.384412 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:43.393163 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b73c9aea-afc6-4f46-9f83-d162bfce0de7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.151437 May 11 21:06:43.393948 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 120/227] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:43 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:43.503666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:43.511380 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:43.512913 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:43.514097 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2e81ec82-3188-408b-9058-a0b8c8a891da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.155577 May 11 21:06:43.514653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 108/228] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:43 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:44.099764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:44.100371 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:44.106544 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.106991 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.107946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.108546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.171135 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:44.179647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b7512370-2770-4356-8d21-8c2186ebaa62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.083558 May 11 21:06:44.180375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 121/229] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:44 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:44.271870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:44.272547 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:44.278786 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.279226 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.279984 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.280416 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.342269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:44.349827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-de31fbf7-1b28-4807-adc7-ee70b35e240d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.081891 May 11 21:06:44.356678 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 109/230] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:44 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:44.410356 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:44.410959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:44.416692 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.417138 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.417919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.418338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.533478 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:44.534123 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:44.539980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.540646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.541479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:44.541938 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:44.544431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:44.552642 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9f0fb4f4-1d1e-4453-ac5f-d69339165442 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.146043 May 11 21:06:44.553210 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 122/231] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:44 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:44.668019 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:44.676437 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:44.677942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:44.679076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ee2ca280-439e-4fe5-9f76-a15f96448799 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.149483 May 11 21:06:44.679628 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 110/232] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:44 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:45.196052 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:45.196635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:45.202753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.203207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.204562 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.204892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.264678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:45.272610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7751bd40-c275-4b99-94a7-599afa8f71fa tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.080412 May 11 21:06:45.273172 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 123/233] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:45 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:45.371146 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:45.371762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:45.378354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.378809 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.379656 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.380096 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.447435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:45.455614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0b7977f7-f3fb-49b4-a8c7-f71c58712d2e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.088366 May 11 21:06:45.456192 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 111/234] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:45 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:45.570378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:45.588567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:45.588567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.588567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.588567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.588963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.697762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:45.698434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:45.704871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.705320 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.706117 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:45.706554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:45.716621 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:45.724026 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d677fe2d-10c5-4cfa-ae24-f12b10ba2ce0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.157839 May 11 21:06:45.724590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 124/235] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:45 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:45.836424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:45.844229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:45.845769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:45.846980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4386fc6f-40d9-480c-aeaa-23863bb7dda3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.153156 May 11 21:06:45.847454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 112/236] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:45 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:46.290003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:46.290740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:46.298073 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.298479 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.299244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.299713 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.360656 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:46.370041 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-15cfa1e4-d0bd-4863-b7aa-1b22a4dfdd62 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.081820 May 11 21:06:46.370041 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 125/237] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:46 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:46.472598 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:46.473103 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:46.479035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.479474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.480451 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.480883 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.546375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:46.553163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-abcec655-8b00-4d62-a8c0-238fd5679428 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.084902 May 11 21:06:46.553751 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 113/238] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:46 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:46.740535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:46.741085 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:46.746938 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.747390 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.748157 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.748611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.864359 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:46.865086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:46.870883 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.873670 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.873670 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:46.873670 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:46.875049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:46.882517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d06b3c58-7042-474d-aeb8-6a9c7dfc3647 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.145898 May 11 21:06:46.883087 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 126/239] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:46 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:47.001287 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:47.009750 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:47.011481 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:47.012831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6e7bd46a-1b11-4848-a838-2bf5e6e99f6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.152470 May 11 21:06:47.013955 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 114/240] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:46 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:47.384190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:47.385172 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:47.391056 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:47.391496 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:47.392247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:47.392704 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:47.454731 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:47.461986 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8ce5cbc7-95b6-433d-9b59-13ba7f55425e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.081713 May 11 21:06:47.465767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 127/241] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:47 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:47.570516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:47.571162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:47.577656 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:47.578134 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:47.578956 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:47.579395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:47.639938 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:47.647611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-aa981904-6725-4a03-9d86-8cfe7a1688e4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.081304 May 11 21:06:47.648175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 115/242] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:47 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:47.899792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:47.900398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:47.906340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:47.907316 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:47.908081 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:47.908540 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:48.032833 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:48.033444 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:48.037348 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:48.039385 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:48.039863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:48.040661 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:48.041146 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:48.045193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b2d84f38-e5bf-4e06-b78a-cb820b7e9e00 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.149523 May 11 21:06:48.045789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 128/243] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:47 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:48.173044 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:48.180672 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:48.182285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:48.183510 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-59df5b90-d10c-4b9b-8f4b-22de430d24f8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.155143 May 11 21:06:48.184066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 116/244] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:48 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:48.479258 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:48.480191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:48.486154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:48.486596 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:48.488368 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:48.488368 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:48.546841 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:48.554647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-330d4f91-d1a8-40dc-a437-ccab63df5ddc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.079571 May 11 21:06:48.555201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 129/245] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:48 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:48.671888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:48.672988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:48.680058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:48.680511 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:48.681274 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:48.681736 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:48.742992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:48.750277 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6d615e77-d297-459b-9bde-a5c571f23b65 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.082823 May 11 21:06:48.750849 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 117/246] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:48 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:49.062358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:49.062997 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:49.068736 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.069187 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.069975 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.070410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.202731 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:49.203973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:49.204112 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:49.209961 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.210496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.211356 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-15ffbd20-6f88-4958-8368-73d68de18790 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.152765 May 11 21:06:49.211472 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.211949 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 130/247] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:49 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:49.221694 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.350982 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:49.363190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:49.363190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:49.363190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a4b992bf-8a17-4c1a-9c93-4899a5cbe9a9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.162879 May 11 21:06:49.363542 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 118/248] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:49 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:49.571989 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:49.572618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:49.578431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.579500 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.580251 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.580746 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.641034 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:49.650193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d4e80735-94ad-4729-90f6-8dd9a145e2b2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.080444 May 11 21:06:49.650193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 131/249] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:49 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:49.772023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:49.772637 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:49.778970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.779424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.780399 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:49.781014 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:49.843580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:49.851470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a9ff5d3f-04bb-4a7f-8c8c-f3ea748f2750 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.083500 May 11 21:06:49.852044 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 119/250] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:49 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:50.228004 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:50.228617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:50.234443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.235537 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.236300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.236738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.374867 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:50.379459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:50.383077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:50.383202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3a3aba5e-8a33-404a-971a-ee7989c32a6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.158627 May 11 21:06:50.383843 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 132/251] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:50 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:50.391739 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.392259 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.393103 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.393645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.524823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:50.533244 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:50.534776 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:50.536040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3afe591c-262b-4ae7-a97e-df2b0657b8e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.160785 May 11 21:06:50.536605 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 120/252] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:50 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:50.665337 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:50.665992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:50.671968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.672413 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.673173 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.673826 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.735233 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:50.742342 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-63df7b8a-4cb2-4dfd-acd6-35bee4284100 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.080841 May 11 21:06:50.749582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 133/253] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:50 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:50.868999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:50.869651 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:50.876587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.888528 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.888528 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:50.888528 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:50.955921 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:50.964234 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c1cfbbd2-9b26-462b-b6a7-d24b22838936 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.099499 May 11 21:06:50.967476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 121/254] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:50 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:51.400234 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:51.401058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:51.407108 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.407766 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:51.408700 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.409294 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:51.542465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:51.550392 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0aac4aee-506d-4fd0-8dcc-b8198ddae199 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.153875 May 11 21:06:51.559506 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 134/255] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:51 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:51.559790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:51.559790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:51.561702 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.562316 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:51.562984 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.563592 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:51.692816 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:51.702214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:51.704760 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:51.706029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5d3be656-665c-4ee6-b0ab-15cbb11cbca1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.154917 May 11 21:06:51.709335 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 122/256] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:51 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:51.760283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:51.760927 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:51.767374 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.767936 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:51.768712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.769221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:51.834344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:51.841850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f943072e-637b-4564-a926-1e75cb92e48d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.086032 May 11 21:06:51.842491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 135/257] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:51 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:51.979959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:51.980913 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:51.987935 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.988376 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:51.989177 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:51.989714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:52.051163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:52.060362 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f9c347bb-d237-4c0f-aafb-6b29b56d0a9a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.082660 May 11 21:06:52.060362 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 123/258] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:51 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:52.567703 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:52.568851 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:52.575329 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:52.575923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:52.576808 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:52.577345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:52.709192 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:52.716718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-08d15875-602e-4a78-85c8-ae3298eaa0e0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.153085 May 11 21:06:52.717286 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 136/259] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:52 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:52.730596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:52.731305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:52.737674 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:52.738126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:52.738888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:52.739323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:52.859059 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:52.859741 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:52.867443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:52.867973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:52.869107 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:52.869684 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:52.871215 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:52.879707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:52.881214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:52.882690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6d0091ce-cb37-495d-a1e4-1a6cf4f0d407 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.155854 May 11 21:06:52.883160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 124/260] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:52 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:52.936672 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:52.944709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a08ea5ee-1e08-480e-b7aa-1c7c45dd245a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.089635 May 11 21:06:52.945809 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 137/261] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:52 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:53.075713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:53.076290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:53.082761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.083241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:53.084047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.084481 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:53.149105 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:53.156823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ed8c7fec-5839-452a-a126-512094fa787c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.085051 May 11 21:06:53.157387 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 125/262] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:53 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:53.733611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:53.734244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:53.740091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.740534 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:53.741295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.741749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:53.874084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:53.881814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6bcd7d6a-2b65-4e92-bc9a-220b628ca82f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.152101 May 11 21:06:53.882469 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 138/263] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:53 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:53.905429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:53.906069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:53.911873 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.912326 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:53.913082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.913513 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:53.962154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:53.962927 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:53.968916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.969366 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:53.970207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:53.970674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:54.032836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:54.039137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:54.040373 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8ef8be8a-0e24-401a-bbb8-e3da7ec71a11 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1245 microversion: 2.1 time: 0.082096 May 11 21:06:54.040939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 139/264] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:53 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:54.046934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:54.048415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:54.049766 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1de7c032-8bad-4b30-985c-378695b2a1ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.148152 May 11 21:06:54.050325 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 126/265] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:53 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:54.174806 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:54.175403 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:54.181111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:54.181590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:54.182353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:54.182786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:54.243236 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:54.254431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5c681a42-652a-4087-9cb9-2dfde5777ee5 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1299 microversion: 2.1 time: 0.084001 May 11 21:06:54.255119 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 140/266] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:54 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:54.899749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:54.900361 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:54.906681 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:54.907132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:54.908784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:54.909280 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.041248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:55.048688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b90ac1de-aa03-41ff-84d0-37ccca1b1f90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.153082 May 11 21:06:55.049256 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 127/267] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:54 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:55.058158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:55.058710 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:55.064826 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:55.065282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.066079 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:55.066519 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.067526 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:55.068136 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:55.074480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:55.074930 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.075703 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:55.076138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.126320 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:55.133929 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3a03df2f-1527-4360-8b69-a90f317de182 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1237 microversion: 2.1 time: 0.079612 May 11 21:06:55.134511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 141/268] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:55 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:55.212925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:55.223476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:55.224972 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:55.226166 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-580af4a1-48a9-4980-972f-ce9f1b6f0ab1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.162399 May 11 21:06:55.226736 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 128/269] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:55 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:55.271704 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:55.272528 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:55.278923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:55.279375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.280151 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:55.280589 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.316222 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:55.316674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:55.318046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lazy-loading 'fault' on Instance uuid f429e01f-413f-41bc-baf7-e72ed484c480 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:06:55.363382 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:55.370666 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-be624e19-9c9b-444b-9998-70a9d2bf1e5c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 200 len: 1304 microversion: 2.1 time: 0.103435 May 11 21:06:55.371323 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 142/270] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:55 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:56.066250 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:56.067033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:56.073606 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.074066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.074879 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.075319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.152442 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:56.153238 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:56.159985 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.160696 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.161721 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.162505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.218516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:56.226800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1bb2d526-6a64-49f8-b9b9-61b37c08ac33 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.164842 May 11 21:06:56.227438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 129/271] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:56 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:56.249137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:56.249906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:56.256588 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.257040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.257853 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.258309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.405848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:56.411346 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:56.413952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:56.415547 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:56.416618 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9f2a9126-329c-4555-9182-cc4eacb09a8c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1744 microversion: 2.20 time: 0.171699 May 11 21:06:56.417174 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 130/272] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:56 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:06:56.419071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5fcf6b07-87b3-4f23-8979-9dc93bbea7d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1293 microversion: 2.1 time: 0.270644 May 11 21:06:56.421580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:56.422367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: f429e01f-413f-41bc-baf7-e72ed484c480] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:56.426961 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 143/273] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:56 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:56.429919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.430504 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.431450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:56.432001 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:56.447064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] HTTP exception thrown: Instance f429e01f-413f-41bc-baf7-e72ed484c480 could not be found. May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Request method failure captured: May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 HTTP/1.1 May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCVJsh9RQfo3mv4IzX_gPA_IuErE1-IrAuPgRy0h_TI7qqCrll8FLOu7q0MTBqqjOJWMkXBJS6sRpjpL3BUu7cmpwfEQol5PiIKJN2VXcW8v-OTUPTbyUsE_S0C2EoUy0tfFAzLrpPBALSiFjyFsZxgOT4nqRO2WGhqBmERvQfpKKMo May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 98ca4d11f5b5459a93b0f97cbfcdc3a2 May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesActionsTest-569771568 May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:06:56.448898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesActionsTest-569771568 May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 98ca4d11f5b5459a93b0f97cbfcdc3a2 May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesActionsTest-569771568 May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesActionsTest-569771568-project May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: 74d61067c8034b6cb80bec103bc404a0 May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesActionsTest-569771568-project May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance f429e01f-413f-41bc-baf7-e72ed484c480 could not be found. May 11 21:06:56.450433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'f429e01f-413f-41bc-baf7-e72ed484c480'} May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f429e01f-413f-41bc-baf7-e72ed484c480 could not be found. May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:06:56.451367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f429e01f-413f-41bc-baf7-e72ed484c480 could not be found. May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f429e01f-413f-41bc-baf7-e72ed484c480 could not be found. May 11 21:06:56.452800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:06:56.454162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Returning 404 to user: Instance f429e01f-413f-41bc-baf7-e72ed484c480 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:06:56.454162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-83a166cd-b7eb-4dbd-a718-677f0cc0fb28 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480" status: 404 len: 111 microversion: 2.1 time: 0.033589 May 11 21:06:56.454162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 131/274] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:56 2022] GET /compute/v2.1/servers/f429e01f-413f-41bc-baf7-e72ed484c480 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:06:56.593250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-735391934", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "networks": [{"uuid": "ed3efa9c-f23b-412c-a6d2-b3886e3eb354"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:56.673838 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] validate_networks() for [('ed3efa9c-f23b-412c-a6d2-b3886e3eb354', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:06:57.192158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:06:57.192158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:06:57.192917 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:06:57.193204 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:06:57.193686 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:06:57.202887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.203336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.204134 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.204590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.220741 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Getting quotas for project 98ca4d11f5b5459a93b0f97cbfcdc3a2. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:06:57.224638 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Getting quotas for user 74d61067c8034b6cb80bec103bc404a0 and project 98ca4d11f5b5459a93b0f97cbfcdc3a2. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:06:57.235375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:06:57.238196 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:06:57.244285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:57.245255 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:57.252486 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.253219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.254284 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.254896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.367480 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-95cbdcc6-b3fa-4cc4-876d-d1422023545f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780288 May 11 21:06:57.374170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 144/275] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:06:57.402696 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-42dcd138-7af7-434f-9dac-519b87167b38 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:57.403429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-42dcd138-7af7-434f-9dac-519b87167b38 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:57.450421 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:57.458795 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-72ee87f0-f655-4858-a8f1-3b947ece2203 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.218638 May 11 21:06:57.459373 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 132/276] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:57 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:57.464674 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:57.465647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:57.476394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-42dcd138-7af7-434f-9dac-519b87167b38 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:57.483785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.483785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.483785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.483785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.484343 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-42dcd138-7af7-434f-9dac-519b87167b38 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1213 microversion: 2.1 time: 0.103471 May 11 21:06:57.484567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 145/277] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:57 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:57.493323 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:57.497439 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:57.506687 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.507205 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.508233 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.509157 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.613480 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:57.621017 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8a3e019e-21b7-4c43-820b-830c2ba3e5f5 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1299 microversion: 2.1 time: 0.135253 May 11 21:06:57.635888 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 146/278] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:57 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:57.679360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:57.688310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:57.691133 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:57.692384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3e6b58e2-099c-44fa-8e5d-70f208958127 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1744 microversion: 2.20 time: 0.231211 May 11 21:06:57.692948 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 133/279] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:57 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:57.712305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a4e8055f-8382-4913-9cf6-87db15388e5d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:57.719014 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4e8055f-8382-4913-9cf6-87db15388e5d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:57.719548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4e8055f-8382-4913-9cf6-87db15388e5d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:57.785429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a4e8055f-8382-4913-9cf6-87db15388e5d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Going to try to stop instance {{(pid=117611) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 21:06:58.099221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a4e8055f-8382-4913-9cf6-87db15388e5d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action" status: 202 len: 0 microversion: 2.1 time: 0.391316 May 11 21:06:58.100188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 147/280] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:06:57 2022] POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:06:58.109650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:58.118417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:58.118417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.118417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.118417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.118847 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.299970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:58.309071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b13bdb5e-8700-4ed8-b6be-252c45ffb545 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.204412 May 11 21:06:58.309917 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 134/281] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:58 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:58.477305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:58.478608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:58.488835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.488835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.488835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.488835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.503674 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8f5f13b0-8dfb-471a-8e71-5195b3e3d840 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:58.505208 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8f5f13b0-8dfb-471a-8e71-5195b3e3d840 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:58.573007 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8f5f13b0-8dfb-471a-8e71-5195b3e3d840 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:58.581262 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8f5f13b0-8dfb-471a-8e71-5195b3e3d840 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1213 microversion: 2.1 time: 0.084411 May 11 21:06:58.582549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 135/282] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:58 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:58.648026 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:58.648633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:58.662268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.662961 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.665460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.666003 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.702648 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:58.713359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6db5a908-b460-4034-9d93-98a2de86bd8a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.240271 May 11 21:06:58.725597 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 148/283] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:58 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:58.731088 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:58.732006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:58.741928 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.742692 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.743716 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.744400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.853797 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:58.861339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8da6f7fc-7225-4006-82cd-daf458e2d966 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.218032 May 11 21:06:58.861938 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 136/284] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:58 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:58.877025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-0f0eadae-fe6b-4c6b-ac2b-d046b43a8883 req-4e15d2ac-7e17-4a76-a59f-012bb9a74dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e6f4c2-0bcd-4a54-854f-638f98f48a25", "name": "network-vif-plugged", "status": "completed", "tag": "17516495-e3a1-4e3b-9f09-7e6a38573ceb"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:58.894094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0f0eadae-fe6b-4c6b-ac2b-d046b43a8883 req-4e15d2ac-7e17-4a76-a59f-012bb9a74dea service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:58.902953 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0f0eadae-fe6b-4c6b-ac2b-d046b43a8883 req-4e15d2ac-7e17-4a76-a59f-012bb9a74dea service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:58.918946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-0f0eadae-fe6b-4c6b-ac2b-d046b43a8883 req-4e15d2ac-7e17-4a76-a59f-012bb9a74dea service nova] Creating event network-vif-plugged:17516495-e3a1-4e3b-9f09-7e6a38573ceb for instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 on hv-cinder-84146 May 11 21:06:58.924808 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-0f0eadae-fe6b-4c6b-ac2b-d046b43a8883 req-4e15d2ac-7e17-4a76-a59f-012bb9a74dea service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051990 May 11 21:06:58.925400 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 137/285] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:59.047819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:59.056714 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:59.058399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:59.059908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0f9c9ecd-6cc2-49c2-818d-07ba3d31d034 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.332711 May 11 21:06:59.060703 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 149/286] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:06:58 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:06:59.328167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:59.328864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:59.347387 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.350499 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.351656 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.358351 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.600935 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:59.601618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:59.617362 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.619191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.623908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.624550 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.645613 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:59.659348 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ac86ee63-eddc-4216-b3bb-42220ef7ed20 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.335842 May 11 21:06:59.661240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 138/287] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:59 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:06:59.707903 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:06:59.722243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f3945173-d376-4c61-beaa-1f5afe9c015a tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1265 microversion: 2.1 time: 0.123201 May 11 21:06:59.722860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 150/288] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:59 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:06:59.741294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:59.742423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:59.754552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.756804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.756804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.756804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.812785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-9c367079-ae75-4191-984f-05a576dfab38 req-085eef18-c57d-416a-a42e-fc2d6e817d20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d723bfd-a4d6-44d4-8910-f88e2b7b395c", "tag": "33495938-b6a2-44d1-a611-20bc7a6ee31c"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:06:59.831891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-9c367079-ae75-4191-984f-05a576dfab38 req-085eef18-c57d-416a-a42e-fc2d6e817d20 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.832899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-9c367079-ae75-4191-984f-05a576dfab38 req-085eef18-c57d-416a-a42e-fc2d6e817d20 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.859999 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-9c367079-ae75-4191-984f-05a576dfab38 req-085eef18-c57d-416a-a42e-fc2d6e817d20 service nova] Creating event network-changed:33495938-b6a2-44d1-a611-20bc7a6ee31c for instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c on hv-cinder-84146 May 11 21:06:59.870300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-9c367079-ae75-4191-984f-05a576dfab38 req-085eef18-c57d-416a-a42e-fc2d6e817d20 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062389 May 11 21:06:59.871381 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 151/289] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:06:59.879890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:06:59.880923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:06:59.904406 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.907174 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:06:59.912731 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:06:59.920712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:00.094861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:00.109805 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7a26e424-a938-486f-8f45-cddc0ade7d40 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.374892 May 11 21:07:00.112314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 139/290] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:59 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:00.126135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:00.127486 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:00.147789 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:00.148358 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:00.153066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:00.153856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:00.472114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:00.482222 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2289112a-2db6-4693-bb91-8cbe40ab9bcc tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.606901 May 11 21:07:00.485009 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 152/291] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:06:59 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:00.527254 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:00.537919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:00.539744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:00.542196 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f6c4196f-1d20-4044-8140-d06d67ec504a tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.428654 May 11 21:07:00.543321 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 140/292] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:00 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:00.705103 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:00.705103 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:00.724451 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:00.724927 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:00.725743 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:00.726251 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:00.740519 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:00.741015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:00.751015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:00.751771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:00.752732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:00.753313 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:00.821313 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:00.829240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-81a52439-c156-43e0-8146-d602efb019d9 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1283 microversion: 2.1 time: 0.093346 May 11 21:07:00.839348 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 141/293] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:00 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:01.026094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:01.035305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-49515229-3254-46ff-a847-816a325f9372 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.349506 May 11 21:07:01.036422 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 153/294] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:00 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:01.129427 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:01.130382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:01.142442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.148307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.154038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.154038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.388653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:01.405814 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6c554532-128a-46e4-aa55-fb7d7b764236 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.281123 May 11 21:07:01.412009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 142/295] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:01 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:01.502622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:01.503231 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:01.511443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.511893 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.512702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.513136 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.561791 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:01.563217 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:01.576316 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.576761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.577557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.577990 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.746760 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:01.755273 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:01.758021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:01.759586 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4b85761f-a5a1-4bb5-9c83-ad47899dfb7f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.203398 May 11 21:07:01.760702 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 143/296] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:01 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:07:01.850577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:01.851378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:01.860838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.864069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.864069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:01.864069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:01.928776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:01.938380 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:01.940756 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-71f4dd1b-6c90-4cec-84a5-c9bf21f9bc43 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.441801 May 11 21:07:01.947972 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c65fb334-ba61-4ba0-80c1-7ee8972c51ae tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1271 microversion: 2.1 time: 0.104848 May 11 21:07:01.950594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 144/297] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:01 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:01.955987 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 154/298] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:01 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:02.053023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:02.053649 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:02.061250 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.061968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.062581 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.063035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.244969 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:02.258619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0f474a6d-da16-43a7-9e25-4706c2c0c867 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.209190 May 11 21:07:02.269715 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 145/299] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:02 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:02.424446 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:02.425543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:02.431638 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.432426 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.433419 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.434058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.653325 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:02.661178 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-90c47d84-1005-4bc4-9f2a-5f30f440de2f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.241038 May 11 21:07:02.670878 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 155/300] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:02 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:02.782162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:02.784003 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:02.798918 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.800363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.800363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.801128 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.960357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:02.964820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:02.978945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.979566 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:02.979864 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.981066 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:02.981955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:02.988732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:02.992267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:02.993747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4e16e332-9125-4abe-ba3c-bcab335025ba tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.215424 May 11 21:07:02.994995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 146/301] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:02 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:03.005124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:03.006061 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:03.012942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:03.013456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:03.014323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:03.014998 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:03.245389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:03.254817 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d3573d3e-8426-4ee7-ad26-2950d2594add tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.258488 May 11 21:07:03.255711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 147/302] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:02 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:03.277237 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:03.278284 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:03.285043 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:03.285586 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:03.286356 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:03.286785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:03.348019 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:03.356007 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-776e177e-e088-449f-9a8c-c616b76e2001 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.399703 May 11 21:07:03.356736 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 156/303] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:02 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:03.421283 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:03.430160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b6149804-b025-4833-82f7-9006bade6167 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.156850 May 11 21:07:03.431190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 148/304] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:03 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:03.678032 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:03.678639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:03.684970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:03.685433 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:03.703878 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:03.703878 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:03.968542 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:03.979543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a5d7c79f-52b0-4595-be12-c72daa88adab tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.305018 May 11 21:07:03.991221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 157/305] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:03 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:04.017513 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:04.019281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:04.030120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.030120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.030120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.030120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.166931 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:04.176895 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:04.178662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:04.180148 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-055fc23a-ac77-449e-9977-faf3b7a35a68 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.169115 May 11 21:07:04.181160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 149/306] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:04 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:07:04.254797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-d04ea9e1-de17-4070-b28e-3081c1f8b09a req-391f4fa5-c23b-4a1d-a248-cf028a8cf596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "518bb2e2-a544-4bcf-8f1e-7983b489a814", "tag": "ecf532cd-f0d2-415d-8d62-af6fa3e46687"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:04.267385 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d04ea9e1-de17-4070-b28e-3081c1f8b09a req-391f4fa5-c23b-4a1d-a248-cf028a8cf596 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.271732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:04.272404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d04ea9e1-de17-4070-b28e-3081c1f8b09a req-391f4fa5-c23b-4a1d-a248-cf028a8cf596 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.272859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:04.283123 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.283875 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.284733 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.285239 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.292160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-d04ea9e1-de17-4070-b28e-3081c1f8b09a req-391f4fa5-c23b-4a1d-a248-cf028a8cf596 service nova] Creating event network-changed:ecf532cd-f0d2-415d-8d62-af6fa3e46687 for instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 on hv-cinder-84146 May 11 21:07:04.300349 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-d04ea9e1-de17-4070-b28e-3081c1f8b09a req-391f4fa5-c23b-4a1d-a248-cf028a8cf596 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048762 May 11 21:07:04.301932 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 158/307] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:07:04.374483 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:04.374483 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:04.381734 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.382321 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.383483 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.384331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.470574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:04.478377 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f80686f0-80ec-4772-a0f7-5ce2582012b4 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.210892 May 11 21:07:04.491021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 150/308] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:04 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:04.491021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:04.491021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:04.492190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.492728 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.493645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:04.494171 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:04.652274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:04.663763 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3de3239e-7fe5-4f65-89ee-d2f08ad73cf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.294858 May 11 21:07:04.673817 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 159/309] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:04 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:04.694067 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:04.705594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-945f106d-083b-4a7f-9d66-75d1aecd5059 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.225382 May 11 21:07:04.706469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 151/310] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:04 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:04.997986 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:04.999220 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:05.006860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.007542 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.008343 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.008775 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.151883 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:05.160649 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b053fbb1-e450-4935-bdbf-6393bbc3924d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.166761 May 11 21:07:05.170576 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 160/311] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:04 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:05.199238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:05.199970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:05.207495 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.208039 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.208899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.209435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.346860 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:05.360774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:05.360774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:05.360774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e6a40817-63b8-4df0-8d87-05849dbf2541 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.163127 May 11 21:07:05.369821 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 152/312] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:05 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:05.498643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:05.499404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:05.508711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.509275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.510150 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.510656 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.649687 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:05.657473 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d7f8e10f-d545-40db-a3dd-8bddbd2d2e4f tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.162605 May 11 21:07:05.667476 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 161/313] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:05 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:05.681093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:05.681820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:05.692131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.692716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.693629 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.694402 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.722989 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:05.724027 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:05.730808 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.731255 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.738462 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:05.738915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:05.861249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:05.872439 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-798cecf8-7049-4656-b4ee-4e815e7ec8c2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.195021 May 11 21:07:05.882999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 153/314] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:05 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:05.919957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:05.932775 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-962e86fa-1ca6-4816-a12f-eef9279e15fd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.214041 May 11 21:07:05.942246 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 162/315] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:05 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:06.178574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:06.179269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:06.189157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.189642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.190604 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.191044 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.344143 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:06.355360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a0db7cd0-126a-4adb-b9e5-c318d035714c tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.180882 May 11 21:07:06.356137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 154/316] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:06 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:06.376384 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:06.378446 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:06.383707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.384155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.384940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.385376 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.531259 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:06.540371 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:06.542029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:06.543329 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d44e9c28-8713-4fc9-aed7-c71716562d8b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.170797 May 11 21:07:06.544056 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 163/317] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:06 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:06.675801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:06.676401 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:06.682283 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.682731 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.683586 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.684021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.812136 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:06.819914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-69952f69-03e7-406f-ac78-b383cb212c1c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.148593 May 11 21:07:06.820573 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 155/318] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:06 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:06.889558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:06.890172 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:06.903911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.904359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.905152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.905609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.957011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:06.957761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:06.963880 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.964405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:06.965245 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:06.965841 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:07.043332 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:07.060535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4b4cc302-e0d7-4f4b-98e4-f0e3f61af333 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.174621 May 11 21:07:07.061678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 164/319] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:06 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:07.134642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:07.144265 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5dba2c2f-98e4-4940-8ecb-5ecc8b0143c9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.191136 May 11 21:07:07.151065 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 156/320] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:06 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:07.372085 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:07.372679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:07.379279 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:07.379910 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:07.380571 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:07.381189 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:07.523695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:07.532055 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-31a8ce16-a62f-4b62-8611-a84faccf4925 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.163705 May 11 21:07:07.533188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 165/321] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:07 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:07.562463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:07.564804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:07.572371 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:07.573123 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:07.575036 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:07.575414 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:07.718618 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:07.730181 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:07.736398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:07.736398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-af178fcb-a791-48d9-b792-e107e5b9eb47 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.174742 May 11 21:07:07.736398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 157/322] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:07 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:07.841864 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:07.842872 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:07.851873 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:07.852565 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:07.853663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:07.854321 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.023416 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:08.045418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f9979ab0-593e-4578-9157-f2159502b38c tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.196971 May 11 21:07:08.045418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 166/323] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:07 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:08.077658 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:08.078281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:08.085828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.089299 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.089299 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.089299 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.167830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:08.168580 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:08.181918 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.183892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.184992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.186035 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.357304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:08.365088 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eaddcc7d-c664-4dbd-bf0e-1db068bdcd19 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.291206 May 11 21:07:08.376092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 158/324] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:08 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:08.463693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:08.474300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-79aea3d6-ca3b-4a7b-9f61-874cdd1cf1f1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.310631 May 11 21:07:08.476343 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 167/325] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:08 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:08.551056 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:08.555199 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:08.570135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.570831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.572654 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.573108 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.752387 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:08.753222 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:08.771576 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.771691 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:08.771814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.773614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:08.774693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:08.778899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2689f059-f0c2-4f45-a4b7-f966cdb9522e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.233845 May 11 21:07:08.789318 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 159/326] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:08 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:08.944586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:08.954961 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:08.957330 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:08.959135 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7fc4e10b-eb17-414c-b02a-04f4ff63ea10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.211287 May 11 21:07:08.960074 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 168/327] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:08 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:09.052727 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:09.053350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:09.070369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.070820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.071626 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.072047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.383211 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:09.384055 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:09.398528 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.399866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.401683 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.402273 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.545055 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:09.555710 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-93966f99-23ce-4695-b28e-4c264d415cfa tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.506693 May 11 21:07:09.559695 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 160/328] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:09 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:09.564396 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-9ac36a0c-0f41-4de3-842b-3087b56be56e req-638e4115-b6ee-4f22-ae38-6fb05069a077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d723bfd-a4d6-44d4-8910-f88e2b7b395c", "name": "network-vif-plugged", "status": "completed", "tag": "33495938-b6a2-44d1-a611-20bc7a6ee31c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:09.583284 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9ac36a0c-0f41-4de3-842b-3087b56be56e req-638e4115-b6ee-4f22-ae38-6fb05069a077 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.586347 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9ac36a0c-0f41-4de3-842b-3087b56be56e req-638e4115-b6ee-4f22-ae38-6fb05069a077 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.617247 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-9ac36a0c-0f41-4de3-842b-3087b56be56e req-638e4115-b6ee-4f22-ae38-6fb05069a077 service nova] Creating event network-vif-plugged:33495938-b6a2-44d1-a611-20bc7a6ee31c for instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c on hv-cinder-84146 May 11 21:07:09.625722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-9ac36a0c-0f41-4de3-842b-3087b56be56e req-638e4115-b6ee-4f22-ae38-6fb05069a077 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064254 May 11 21:07:09.626885 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 161/329] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:07:09.633572 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:09.634496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:09.642476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.643125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.644208 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.644821 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.648581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:09.661354 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d097f8bd-7c25-4398-ad94-5935f244bea7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.280578 May 11 21:07:09.670605 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 169/330] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:09 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:09.796068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:09.796669 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:09.803630 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.804279 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.804646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:09.805502 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:09.806193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:09.818647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1ec41fe3-d189-4c5b-8efe-5c87e232e20f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.190386 May 11 21:07:09.831601 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 162/331] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:09 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:09.993219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:09.993868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:10.010152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.010152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.017309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.018087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.023605 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:10.032057 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6644bbbb-1725-4031-90fa-0b17841253a8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.239686 May 11 21:07:10.033414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 170/332] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:09 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:10.213061 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:10.222763 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:10.224267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:10.225436 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-29ef88a5-4d2c-477c-9582-447fb28c4084 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.238877 May 11 21:07:10.226584 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 163/333] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:09 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:10.590358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:10.590358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:10.590358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.590358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.590753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.590753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.676078 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:10.676693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:10.695732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.696612 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.697681 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.698807 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.724649 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:10.732173 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9544a4ac-7bd3-4b79-9e7e-fcd4671c19b6 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.163437 May 11 21:07:10.732754 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 171/334] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:10 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:10.838529 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:10.847738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:10.848358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:10.854290 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.854738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.855509 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:10.855646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-68c2cf01-4cba-4714-a77b-9a360591541a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.182783 May 11 21:07:10.855988 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:10.866162 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 164/335] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:10 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:10.996174 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:11.004901 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a663681b-cd08-4766-96f9-4a29ef4f2e56 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.161574 May 11 21:07:11.005462 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 172/336] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:10 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:11.048800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:11.049404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:11.055793 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.056240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.057008 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.057444 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.209557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:11.218956 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a7fcabac-dfba-460f-8de3-89d28d592d99 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1521 microversion: 2.1 time: 0.173877 May 11 21:07:11.220342 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 165/337] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:11 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:11.255511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:11.256793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:11.264860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.265323 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.266295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.267450 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.488011 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:11.496131 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:11.497967 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:11.499367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-85e89fb7-3931-4184-aac3-5fe987983b61 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.251883 May 11 21:07:11.510950 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 173/338] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:11 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:11.750116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:11.751581 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:11.758484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.759394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.760377 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.761012 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.874603 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:11.875207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:11.883470 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.885355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.886296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:11.887418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:11.995774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.009026 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-53bd1cc0-0de0-4972-a8d8-27d8cbe6ec74 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.263717 May 11 21:07:12.009657 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 166/339] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:11 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:12.024266 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:12.025142 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:12.032409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.038193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.039212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.039923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.100884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.110762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b40f5d49-426d-4f8a-a383-8f151d1b7bda tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.240412 May 11 21:07:12.112021 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 174/340] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:11 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:12.240949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.242321 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:12.243560 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:12.256354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f3d3bec8-a38d-4086-8c06-5b015b87c70a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.237563 May 11 21:07:12.257112 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 167/341] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:12 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:12.257288 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.258099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.258885 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.259316 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.398618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.407926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-39505c6d-5754-439e-8852-9ddce5e5a484 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1501 microversion: 2.1 time: 0.171116 May 11 21:07:12.419289 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 175/342] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:12 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:12.426116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:12.426891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:12.434440 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.434999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.435920 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.436453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.519975 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:12.521070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:12.527674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.528211 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.529064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:12.529700 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:12.592211 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.601352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ae7ef10d-2c49-4815-bcc6-3b063449dc6f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1515 microversion: 2.1 time: 0.180466 May 11 21:07:12.602042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 168/343] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:12 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:12.690853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.704065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.706020 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:12.707557 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8b077925-d556-43c5-8f6e-482737b50071 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1739 microversion: 2.20 time: 0.191732 May 11 21:07:12.708820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 176/344] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:12 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:07:13.026499 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:13.027120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:13.034841 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.035577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.036363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.036798 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.129717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:13.130213 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:13.137201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.141761 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.142610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.148075 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.192931 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:13.217864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-827fec6a-396a-43c9-a65c-9547a17ed5e8 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.195395 May 11 21:07:13.229687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 169/345] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:13 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:13.277971 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:13.279869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:13.293178 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.293969 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.294923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.295488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.312885 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:13.321722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9636b7b0-7324-48ec-a2fd-042fea348af4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1367 microversion: 2.1 time: 0.197715 May 11 21:07:13.336140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 177/346] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:13 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:13.401782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-6ed2e529-f738-4985-b8e1-a1dd4d109395 req-1d6a76d1-1bfc-4373-9fe4-a73c94630013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518bb2e2-a544-4bcf-8f1e-7983b489a814", "name": "network-vif-plugged", "status": "completed", "tag": "ecf532cd-f0d2-415d-8d62-af6fa3e46687"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:13.415058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6ed2e529-f738-4985-b8e1-a1dd4d109395 req-1d6a76d1-1bfc-4373-9fe4-a73c94630013 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.420661 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6ed2e529-f738-4985-b8e1-a1dd4d109395 req-1d6a76d1-1bfc-4373-9fe4-a73c94630013 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.453734 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-6ed2e529-f738-4985-b8e1-a1dd4d109395 req-1d6a76d1-1bfc-4373-9fe4-a73c94630013 service nova] Creating event network-vif-plugged:ecf532cd-f0d2-415d-8d62-af6fa3e46687 for instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 on hv-cinder-84146 May 11 21:07:13.460320 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-6ed2e529-f738-4985-b8e1-a1dd4d109395 req-1d6a76d1-1bfc-4373-9fe4-a73c94630013 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064902 May 11 21:07:13.461180 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 178/347] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:07:13.494699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:13.509580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6901a960-10f4-4fa1-a5d8-2747991d8ac6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.234200 May 11 21:07:13.509580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 170/348] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:13 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:13.726492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:13.727190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:13.733466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.734063 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.734880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:13.735823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:13.895697 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:13.903603 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:13.905085 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:13.906309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ae67549c-a39d-4ea3-bf79-07c695805b96 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1721 microversion: 2.20 time: 0.184041 May 11 21:07:13.906905 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 179/349] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:13 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:14.235825 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:14.236429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:14.242747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.243331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.244134 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.244631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.339215 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:14.339821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:14.346287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.346728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.350670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.350670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.376078 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:14.383634 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d94d9fa1-7610-46af-98dc-5be7abe37dd0 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.152297 May 11 21:07:14.384203 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 171/350] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:14 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:14.526068 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:14.526980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:14.533599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.534216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.535017 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.535444 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.573949 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:14.586753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-affbb348-6cf0-45d7-a10c-c2f0bd7304ca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1556 microversion: 2.1 time: 0.251065 May 11 21:07:14.587871 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 180/351] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:14 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:14.593092 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:14.594125 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:14.603626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.604075 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.604870 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.605296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.630566 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lazy-loading 'flavor' on Instance uuid a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:07:14.686659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:14.695725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-94e12c19-e557-418a-942a-0073354e2d1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.173917 May 11 21:07:14.696429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 172/352] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:14 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:14.701209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3e9160c5-52f6-4e9c-b259-8d240494765e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:14.701831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3e9160c5-52f6-4e9c-b259-8d240494765e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:14.709492 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e9160c5-52f6-4e9c-b259-8d240494765e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.710096 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e9160c5-52f6-4e9c-b259-8d240494765e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.711113 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e9160c5-52f6-4e9c-b259-8d240494765e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.711559 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e9160c5-52f6-4e9c-b259-8d240494765e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.798232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3e9160c5-52f6-4e9c-b259-8d240494765e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100504 May 11 21:07:14.798912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 173/353] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:07:14 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:07:14.901289 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bcabeb30-e33d-472f-bff4-d28b1d0e19f0 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b/action" status: 200 len: 32 microversion: 2.1 time: 0.312115 May 11 21:07:14.901926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 181/354] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:07:14 2022] POST /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:07:14.910888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:14.911495 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:14.917497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.918060 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.918826 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.919258 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.934295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:14.935416 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:14.942997 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.944140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:14.944983 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:14.945505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:15.111852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:15.121378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:15.124081 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:15.125548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-84114dd0-af14-4021-8e92-590033d77db7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1721 microversion: 2.20 time: 0.203179 May 11 21:07:15.138150 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 182/355] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:14 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:15.176936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:15.187224 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1c206222-0476-4d65-a639-b9aea7508e60 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.280151 May 11 21:07:15.187812 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 174/356] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:14 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:15.401622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:15.402323 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:15.408274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:15.408829 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:15.409639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:15.410077 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:15.542427 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:15.551459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3dde77f3-0dd2-4406-b685-2db046199759 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.153570 May 11 21:07:15.552112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 183/357] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:15 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:15.714437 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:15.715058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:15.724085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:15.724550 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:15.726186 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:15.726636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:15.916983 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:15.925327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7e6da453-605a-4a98-9c5d-ca7b1b2537e7 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.215126 May 11 21:07:15.926286 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 175/358] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:15 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:16.022917 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-a9e7a477-a7c2-45e0-8758-4c07cc12176b req-742e26a4-607e-4995-8592-0c94522499a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d723bfd-a4d6-44d4-8910-f88e2b7b395c", "tag": "33495938-b6a2-44d1-a611-20bc7a6ee31c"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:16.030873 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a9e7a477-a7c2-45e0-8758-4c07cc12176b req-742e26a4-607e-4995-8592-0c94522499a0 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.031317 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a9e7a477-a7c2-45e0-8758-4c07cc12176b req-742e26a4-607e-4995-8592-0c94522499a0 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.042850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-a9e7a477-a7c2-45e0-8758-4c07cc12176b req-742e26a4-607e-4995-8592-0c94522499a0 service nova] Creating event network-changed:33495938-b6a2-44d1-a611-20bc7a6ee31c for instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c on hv-cinder-84146 May 11 21:07:16.047833 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-a9e7a477-a7c2-45e0-8758-4c07cc12176b req-742e26a4-607e-4995-8592-0c94522499a0 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028770 May 11 21:07:16.048422 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 184/359] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:07:16.152806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:16.152806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:16.158742 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.159256 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.160056 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.160790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.211567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:16.212317 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:16.219029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.220249 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.221274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.221744 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.318161 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:16.330059 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:16.331757 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:16.333192 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8963b282-57d6-42ad-9094-679d3a56f478 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1721 microversion: 2.20 time: 0.192698 May 11 21:07:16.339465 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 176/360] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:16 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:16.366485 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:16.374523 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5586fed5-bbe4-4727-b090-09daf285ddba tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.167346 May 11 21:07:16.375114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 185/361] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:16 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:16.568329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:16.568934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:16.574846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.575304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.576047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.576474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.706611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:16.714318 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a5936fbc-e843-42eb-99c1-372906ec101e tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1313 microversion: 2.1 time: 0.149768 May 11 21:07:16.714921 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 177/362] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:16 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:16.942898 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:16.943598 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:16.955293 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.957457 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:16.958363 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:16.958869 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:17.104023 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:17.113478 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-08d41338-ef3a-4bb9-ab76-b6f47e146bd1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.174400 May 11 21:07:17.114187 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 186/363] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:16 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:17.307174 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-975c65d5-93a5-44be-b500-ea910aaf7ac0 req-3410ba05-4fb8-44a3-ab20-cf5ef794d574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e6f4c2-0bcd-4a54-854f-638f98f48a25", "name": "network-vif-unplugged", "status": "completed", "tag": "17516495-e3a1-4e3b-9f09-7e6a38573ceb"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:17.315924 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-975c65d5-93a5-44be-b500-ea910aaf7ac0 req-3410ba05-4fb8-44a3-ab20-cf5ef794d574 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:17.316360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-975c65d5-93a5-44be-b500-ea910aaf7ac0 req-3410ba05-4fb8-44a3-ab20-cf5ef794d574 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:17.327661 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-975c65d5-93a5-44be-b500-ea910aaf7ac0 req-3410ba05-4fb8-44a3-ab20-cf5ef794d574 service nova] Creating event network-vif-unplugged:17516495-e3a1-4e3b-9f09-7e6a38573ceb for instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 on hv-cinder-84146 May 11 21:07:17.336838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-975c65d5-93a5-44be-b500-ea910aaf7ac0 req-3410ba05-4fb8-44a3-ab20-cf5ef794d574 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030097 May 11 21:07:17.336838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 178/364] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:07:17.352133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:17.352737 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:17.359012 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:17.359468 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:17.360290 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:17.360737 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:17.392242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:17.399786 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:17.399786 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:17.400308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:17.401117 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:17.401582 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:17.563413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:17.574157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5f73f3d9-1684-41a7-bbda-709a4fce2980 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.186524 May 11 21:07:17.575219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 179/365] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:17 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:17.624069 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:17.636860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:17.638690 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:17.640039 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-42b68073-35ce-4509-8e20-1a155c1726da tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1721 microversion: 2.20 time: 0.291826 May 11 21:07:17.640685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 187/366] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:17 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:17.731510 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:17.732150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:17.747503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:17.748852 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:17.749882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:17.750834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:18.124987 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:18.134711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:18.135355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:18.135843 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4c707707-7209-4886-a71b-ffdfc1f85c82 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1498 microversion: 2.1 time: 0.407300 May 11 21:07:18.136849 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 180/367] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:17 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1498 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:18.147892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:18.147892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:18.147892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:18.147892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:18.592961 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:18.593688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:18.600939 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:18.601389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:18.608264 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:18.608725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:18.735595 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:18.755341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-61fe37f1-3314-4fc8-8d35-47d7727292d2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.627194 May 11 21:07:18.756472 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 188/368] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:18 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:18.768479 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:18.768479 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:18.775384 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:18.776151 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:18.777100 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:18.777597 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:18.791560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:18.801235 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-91744295-3af6-412f-bd76-cce3482ab0a2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.212487 May 11 21:07:18.811004 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 181/369] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:18 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:18.976583 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:18.984915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:18.986466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:18.987609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d6eaf6db-5b1e-419c-a979-fd9a3f04d1f2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1664 microversion: 2.20 time: 0.229711 May 11 21:07:18.988162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 189/370] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:18 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1664 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:19.007180 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-edd28367-90cb-4b60-804d-b6ffe83f88bd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2142b38a-c323-47cb-89ce-8b9b1207942a"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:19.008436 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-edd28367-90cb-4b60-804d-b6ffe83f88bd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:19.014804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edd28367-90cb-4b60-804d-b6ffe83f88bd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.015259 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edd28367-90cb-4b60-804d-b6ffe83f88bd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.016556 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edd28367-90cb-4b60-804d-b6ffe83f88bd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.018206 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edd28367-90cb-4b60-804d-b6ffe83f88bd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.117908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:19.118388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:19.124175 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.124617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.125414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.125877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.151703 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:07:19.496689 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a00be672-d77f-4b8c-8068-4b6103f342dd tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "DELETE /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 204 len: 0 microversion: 2.1 time: 0.382285 May 11 21:07:19.497277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 190/371] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:07:19 2022] DELETE /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 21:07:19.506287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:19.506977 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:19.512679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.513130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.513955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.514392 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.652044 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:19.660359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4da008b2-be35-402f-8912-e1fa9db48a24 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1504 microversion: 2.1 time: 0.158104 May 11 21:07:19.661170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 191/372] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:19 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:19.772310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:19.773099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:19.778745 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.779193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.779953 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.780386 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.940974 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:19.949293 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2d8ef7fc-32b5-4bea-b284-e393c1fd998d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.181070 May 11 21:07:19.950090 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 192/373] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:19 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:19.964866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:19.965459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:19.971663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.972106 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:19.972863 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:19.973297 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.104947 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:20.113125 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c7869419-ccbe-41c9-a32c-a0a0ab0a89e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.152077 May 11 21:07:20.113708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 193/374] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:19 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:20.127774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-edd28367-90cb-4b60-804d-b6ffe83f88bd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.124451 May 11 21:07:20.128442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 182/375] 10.222.0.35 () {62 vars in 1363 bytes} [Wed May 11 21:07:19 2022] POST /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments => generated 188 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 21:07:20.256408 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-29dbfcec-c16e-40e3-8ca9-b77bb5818c0e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:20.256971 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-29dbfcec-c16e-40e3-8ca9-b77bb5818c0e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:20.262817 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29dbfcec-c16e-40e3-8ca9-b77bb5818c0e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.263267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29dbfcec-c16e-40e3-8ca9-b77bb5818c0e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.264025 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29dbfcec-c16e-40e3-8ca9-b77bb5818c0e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.264459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-29dbfcec-c16e-40e3-8ca9-b77bb5818c0e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.567143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-29dbfcec-c16e-40e3-8ca9-b77bb5818c0e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/action" status: 202 len: 0 microversion: 2.20 time: 0.314526 May 11 21:07:20.567930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 194/376] 10.222.0.35 () {62 vars in 1318 bytes} [Wed May 11 21:07:20 2022] POST /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 21:07:20.575914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:20.576510 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:20.584854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.585683 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.587007 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.587754 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.677448 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:20.678411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:20.684578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.685300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.686334 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.687129 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.749440 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:20.760718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:20.762378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:20.763540 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6f10f458-bedb-4e90-924d-ca31ed8cd0a1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1750 microversion: 2.20 time: 0.191687 May 11 21:07:20.764405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 183/377] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:20 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:20.863723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:20.871241 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-065470da-9ca1-443b-aa9d-0c544b9cba23 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1504 microversion: 2.1 time: 0.197607 May 11 21:07:20.875266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 195/378] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:20 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:20.968537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:20.970219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:20.979585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.980006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:20.980977 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:20.981500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:21.114999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:21.122997 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0296772a-a24b-402b-b03b-e05c6c43cf0d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.159339 May 11 21:07:21.123788 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 184/379] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:20 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:21.142584 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:21.142584 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:21.146268 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:21.147156 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:21.148247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:21.148880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:21.406427 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:21.416323 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-103276ac-e4be-4319-a6b2-13e4bf49ed90 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.289812 May 11 21:07:21.416995 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 196/380] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:21 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:21.783558 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:21.784770 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:21.793708 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:21.794441 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:21.795400 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:21.795993 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:21.888824 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:21.889475 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:21.899216 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:21.899666 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:21.905264 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:21.905945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:22.001678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:22.010439 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5f162bf7-8272-4ff9-924b-754ebe4214cf tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1462 microversion: 2.1 time: 0.126104 May 11 21:07:22.011690 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 197/381] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:21 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1462 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:22.017646 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-b3300872-4618-4add-a63f-ceadcb18577b req-d91a6267-c52b-40df-af4b-e0613b426603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518bb2e2-a544-4bcf-8f1e-7983b489a814", "name": "network-vif-deleted", "tag": "ecf532cd-f0d2-415d-8d62-af6fa3e46687"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:22.029606 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-b3300872-4618-4add-a63f-ceadcb18577b req-d91a6267-c52b-40df-af4b-e0613b426603 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:22.030392 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-b3300872-4618-4add-a63f-ceadcb18577b req-d91a6267-c52b-40df-af4b-e0613b426603 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:22.043268 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-b3300872-4618-4add-a63f-ceadcb18577b req-d91a6267-c52b-40df-af4b-e0613b426603 service nova] Creating event network-vif-deleted:ecf532cd-f0d2-415d-8d62-af6fa3e46687 for instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 on hv-cinder-84146 May 11 21:07:22.049022 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-b3300872-4618-4add-a63f-ceadcb18577b req-d91a6267-c52b-40df-af4b-e0613b426603 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035993 May 11 21:07:22.050064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 198/382] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:07:22.111411 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:22.121863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:22.123665 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:22.126285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-74f7062d-af6e-4e85-8cb6-627abb276992 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1750 microversion: 2.20 time: 0.346552 May 11 21:07:22.127816 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 185/383] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:21 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1750 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:22.141322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:22.142387 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:22.161328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:22.161826 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:22.162637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:22.163098 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:22.322818 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:22.337184 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e3fcfb91-ec02-44f9-848b-5c0cb3152fc5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.200645 May 11 21:07:22.337804 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 199/384] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:22 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:22.448025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:22.448025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:22.453076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:22.453568 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:22.454358 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:22.454795 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:22.685988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:22.693332 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-84d3c089-1c44-440a-b3f5-bf956d496561 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.263366 May 11 21:07:22.694159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 186/385] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:22 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:23.029112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:23.029772 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:23.036518 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.036970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.037795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.038236 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.083645 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.083645 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.083645 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lazy-loading 'fault' on Instance uuid 518bb2e2-a544-4bcf-8f1e-7983b489a814 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:07:23.123821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d61067c8034b6cb80bec103bc404a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:23.132148 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-65a484f6-77bf-468e-9f14-ef78e833e17d tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 200 len: 1303 microversion: 2.1 time: 0.106818 May 11 21:07:23.132719 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 200/386] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:23 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:23.148629 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:23.152083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:23.157471 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.158158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.158936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.159360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.355353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:23.358282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:23.364981 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.365731 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.366513 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.367117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.427749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:23.436660 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:23.444186 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:23.445706 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-43ddc10b-b303-451a-9aa6-8d62b7f2ccc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1752 microversion: 2.20 time: 0.301835 May 11 21:07:23.452504 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 187/387] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:23 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1752 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:23.554363 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:23.568892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-93ac0225-6797-4c67-8ad1-c8d2f1fd34dc tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1723 microversion: 2.1 time: 0.217461 May 11 21:07:23.569494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 201/388] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:23 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:23.710574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:23.711251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:23.717205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.717756 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.718804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:23.719241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:23.965324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:23.971412 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fcf0b987-3475-462a-be40-8a43064747f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.264600 May 11 21:07:23.971991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 188/389] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:23 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:24.150505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:24.151797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] [instance: 518bb2e2-a544-4bcf-8f1e-7983b489a814] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:24.158835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:24.159274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:24.160431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:24.161040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:24.175760 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] HTTP exception thrown: Instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 could not be found. May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Request method failure captured: May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 HTTP/1.1 May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCVJsh9RQfo3mv4IzX_gPA_IuErE1-IrAuPgRy0h_TI7qqCrll8FLOu7q0MTBqqjOJWMkXBJS6sRpjpL3BUu7cmpwfEQol5PiIKJN2VXcW8v-OTUPTbyUsE_S0C2EoUy0tfFAzLrpPBALSiFjyFsZxgOT4nqRO2WGhqBmERvQfpKKMo May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 98ca4d11f5b5459a93b0f97cbfcdc3a2 May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesActionsTest-569771568 May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:07:24.177423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/98ca4d11f5b5459a93b0f97cbfcdc3a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesActionsTest-569771568 May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 98ca4d11f5b5459a93b0f97cbfcdc3a2 May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesActionsTest-569771568 May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesActionsTest-569771568-project May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 74d61067c8034b6cb80bec103bc404a0 May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesActionsTest-569771568-project May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 could not be found. May 11 21:07:24.179206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '518bb2e2-a544-4bcf-8f1e-7983b489a814'} May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 could not be found. May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:07:24.180086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 could not be found. May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 could not be found. May 11 21:07:24.181579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:07:24.182850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] Returning 404 to user: Instance 518bb2e2-a544-4bcf-8f1e-7983b489a814 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:07:24.182850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c96e76a3-c02d-4edc-a138-9b1f6f77a978 tempest-VolumesActionsTest-569771568 tempest-VolumesActionsTest-569771568-project] 10.222.0.35 "GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814" status: 404 len: 111 microversion: 2.1 time: 0.032766 May 11 21:07:24.199738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 202/390] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:24 2022] GET /compute/v2.1/servers/518bb2e2-a544-4bcf-8f1e-7983b489a814 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:07:24.464564 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:24.465886 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:24.477740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:24.478635 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:24.479894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:24.480478 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:24.587932 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:24.588811 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:24.595488 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:24.596151 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:24.597098 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:24.597712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:24.824159 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:24.835038 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5bb59d4d-b198-4312-a36e-9ef611a6f823 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1700 microversion: 2.1 time: 0.251697 May 11 21:07:24.835819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 203/391] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:24 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1700 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:24.854049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-45a4a0ef-0222-4d32-98a8-c25d24e0520e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:24.860569 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45a4a0ef-0222-4d32-98a8-c25d24e0520e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:24.861219 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-45a4a0ef-0222-4d32-98a8-c25d24e0520e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:24.865020 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:24.878314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:24.879891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:24.881311 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-244949af-3716-4506-9b5e-b32f1d042807 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1752 microversion: 2.20 time: 0.420742 May 11 21:07:24.881900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 189/392] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:24 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1752 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:24.892095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-45a4a0ef-0222-4d32-98a8-c25d24e0520e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Going to try to start instance {{(pid=117611) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 21:07:24.988633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:24.989482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:24.996766 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:25.010244 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:25.011634 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:25.012230 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:25.061218 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-45a4a0ef-0222-4d32-98a8-c25d24e0520e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action" status: 202 len: 0 microversion: 2.1 time: 0.213244 May 11 21:07:25.073237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 204/393] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:07:24 2022] POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:07:25.084139 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:25.085653 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:25.092820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:25.094250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:25.095285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:25.095874 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:25.225152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:25.239533 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1dd3b61e-6117-4a5b-af02-ec0705d084f6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.254418 May 11 21:07:25.243198 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 190/394] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:24 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:25.328870 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:25.338496 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0186b54a-0879-45b2-9954-2d4946a7b703 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1709 microversion: 2.1 time: 0.263873 May 11 21:07:25.341578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 205/395] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:25 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1709 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:25.902237 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:25.902980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:25.912635 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:25.913224 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:25.914352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:25.914988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:26.142446 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:26.154591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:26.156832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:26.158075 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ff7f4c19-632d-4d02-a18a-450a1bfce9e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.262069 May 11 21:07:26.158632 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 191/396] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:25 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:26.257088 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:26.257754 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:26.266394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:26.267076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:26.268104 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:26.268802 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:26.359910 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:26.360972 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:26.373195 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:26.373702 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:26.374487 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:26.377034 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:26.492242 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:26.519136 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-95822553-7ed3-487c-829d-448d0f1f39b4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.265940 May 11 21:07:26.519920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 206/397] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:26 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:26.613127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:26.628089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bd0b3ff9-69b8-4fe0-8cf1-f11237b02e21 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1709 microversion: 2.1 time: 0.273034 May 11 21:07:26.629174 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 192/398] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:26 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1709 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:27.176245 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:27.176840 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:27.182831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:27.183210 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:27.183961 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:27.184386 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:27.322810 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:27.331080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:27.332554 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:27.333733 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e4ff1ac1-45eb-4015-abe9-a04c05f17ce7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.161390 May 11 21:07:27.334292 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 207/399] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:27 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:27.537433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:27.538160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:27.544718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:27.545254 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:27.546160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:27.546589 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:27.646940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:27.647560 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:27.654267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:27.661675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:27.661675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:27.661675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:27.705371 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:27.713193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3e02ebc7-2908-47bb-85f6-80ce2cb4d588 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.180266 May 11 21:07:27.725413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 193/400] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:27 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:27.795668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:27.804732 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6818ebea-3b19-40ca-b908-13fbe6f053c0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1709 microversion: 2.1 time: 0.162520 May 11 21:07:27.805387 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 208/401] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:27 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:28.352511 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:28.353733 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:28.360787 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:28.361242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:28.362163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:28.362486 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:28.524461 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:28.532615 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:28.534130 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:28.535369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-162d96c7-d6e9-4477-86af-007ebc9cddb0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.186935 May 11 21:07:28.535930 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 194/402] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:28 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:28.730769 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:28.731954 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:28.739019 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:28.739467 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:28.740244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:28.740676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:28.822719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:28.826222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:28.833640 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:28.834275 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:28.835325 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:28.836011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:28.920137 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:28.929635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3c374c34-7810-43e7-a554-5b1373712599 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.200574 May 11 21:07:28.929635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 209/403] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:28 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:29.008918 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:29.018124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ac3b8c48-914d-4193-b0fb-0c0150086c9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1709 microversion: 2.1 time: 0.199135 May 11 21:07:29.019024 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 195/404] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:28 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1709 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:29.553916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:29.554510 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:29.561142 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:29.561859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:29.563440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:29.564027 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:29.956734 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:29.957992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:29.970664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:29.973932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:29.975767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:29.977587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:30.114670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:30.130920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:30.132626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:30.133819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d9402d27-f9b1-4126-a41c-4d674891fab3 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.583874 May 11 21:07:30.134389 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 210/405] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:29 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:30.143720 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:30.144329 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:30.151161 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:30.152080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:30.153756 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:30.154397 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:30.256553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:30.264314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ec3288c7-e6b9-4b2c-9d8c-b41c8ea3312f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.322026 May 11 21:07:30.271846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 196/406] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:29 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:30.412008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:30.420731 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d2743193-a33e-4204-a00b-ad0151af5c9b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1709 microversion: 2.1 time: 0.285289 May 11 21:07:30.421305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 211/407] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:30 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1709 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:31.157208 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:31.157977 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:31.185577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:31.199191 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:31.199191 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:31.199191 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:31.284001 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:31.285190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:31.312163 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:31.322908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:31.324353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:31.325244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:31.600864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:31.600864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:31.601889 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:31.601889 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bac9c42a-e43f-4885-8df8-31c109d1d428 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.346421 May 11 21:07:31.601889 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 197/408] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:31 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:31.601889 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:31.602293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:31.602293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:31.602293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:31.602293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:31.602605 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:31.760610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:31.780375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ebb37359-8bdc-46a4-86fa-aee93586f8b1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.500913 May 11 21:07:31.799137 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 212/409] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:31 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:31.811582 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:31.823134 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eb354b72-7a2f-47fa-9231-8754a03d382d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1713 microversion: 2.1 time: 0.321528 May 11 21:07:31.823818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 198/410] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:31 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1713 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:32.596267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:32.597579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:32.611571 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:32.612365 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:32.613362 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:32.613976 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:32.799364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:32.801509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:32.812462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:32.814045 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:32.817952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:32.818604 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:33.086419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:33.102907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-db7337b4-31e7-488c-82b0-bba08d811dc5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.308702 May 11 21:07:33.104037 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 199/411] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:32 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:33.232770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:33.246885 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:33.254790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:33.256369 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-667fa40a-3133-41b3-ac54-7a7d208cd99f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.665838 May 11 21:07:33.259367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 213/412] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:32 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:34.120653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:34.121967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:34.142454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:34.142982 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:34.143927 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:34.144462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:34.278581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:34.279979 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:34.287873 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:34.288751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:34.289823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:34.290732 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:34.540043 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:34.572099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:34.577420 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:34.584807 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-75404048-8ca5-4e85-9cde-3f8cedd551d9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.310364 May 11 21:07:34.586093 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 214/413] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:34 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:07:34.742896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:34.758884 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b448d88b-d9a5-4f69-b446-24ca31433cb5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.642202 May 11 21:07:34.776533 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 200/414] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:34 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:35.605338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:35.606572 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:35.616658 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:35.618529 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:35.620774 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:35.623207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:35.778579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:35.779884 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:35.792951 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:35.795203 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:35.799438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:35.800590 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:35.977490 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:36.021830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:36.028946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:36.030082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1552c818-45a7-45b7-9a62-e0d89386d138 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.430020 May 11 21:07:36.031854 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 215/415] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:35 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:36.152405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:36.160538 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-637f27a3-4fad-4937-8730-8b0aea36e5fe tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.386951 May 11 21:07:36.161354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 201/416] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:35 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:37.058127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:37.058127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:37.067150 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:37.067625 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:37.072077 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:37.072591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:37.190096 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:37.190697 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:37.198069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:37.198769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:37.199744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:37.204917 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:37.397737 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:37.424344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:37.424344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:37.424344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fafae04e-69c7-4011-bd53-8bc6c6fd9e45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.369887 May 11 21:07:37.428988 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 216/417] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:37 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:37.553802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:37.562019 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fe8cdff1-72e3-4ec5-bba0-3607386b51f9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.386529 May 11 21:07:37.563368 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 202/418] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:37 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:37.995693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8fc2c91a-b951-4f47-a1bf-67913661f523 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Action: 'create', calling method: .version_select at 0x7ff8982bc790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1320302024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZf59WT7ltDmuB8W8591fcxcSo2gKWidTaHVY+ml9fZnpsE6HmkqprFgyjfijcILkJUk8l6ohWpIAN4nQdCX0xCRjuki4NA6s2L+w408JOvesc0wRYXivNw7SfJ3lxf6A=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:38.027423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-8fc2c91a-b951-4f47-a1bf-67913661f523 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:07:38.032056 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-8fc2c91a-b951-4f47-a1bf-67913661f523 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for user 3a47bfbd0a2e459cabaa30d74f45811a and project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:07:38.170028 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8fc2c91a-b951-4f47-a1bf-67913661f523 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.572264 May 11 21:07:38.170928 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 217/419] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:07:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:07:38.434296 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:38.434995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:38.449409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:38.450026 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:38.450940 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:38.451483 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:38.580844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:38.589995 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:38.599930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:38.611070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:38.612209 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:38.612911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:38.783084 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:38.800699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:38.807540 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:38.808899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ef709139-65bf-4498-9403-9b9bd699e9cc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.378793 May 11 21:07:38.809521 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 203/420] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:38 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:38.947322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:38.947322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4d756681-5d98-46e3-93de-e315961bd304 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.365771 May 11 21:07:38.947322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 218/421] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:38 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:39.833493 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:39.839842 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:39.850246 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:39.856097 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:39.858756 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:39.862648 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:39.975480 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:39.980127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:39.996439 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:39.997485 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:39.998821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:39.999906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:40.151127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:40.169066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:40.170083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:40.177030 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-05e72a9e-8c50-4fba-a19b-7d0397e98a85 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.348519 May 11 21:07:40.191986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 204/422] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:39 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:40.266691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:40.277673 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4787e622-1ccc-464f-828f-0392ac03096f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.317981 May 11 21:07:40.278396 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 219/423] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:39 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:41.206595 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:41.207279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:41.237417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:41.238718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:41.244259 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:41.247435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:41.303582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:41.304836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:41.314953 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:41.318399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:41.319505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:41.320949 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:41.713557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:41.730176 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:41.735785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:41.738369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a189544b-ef00-462f-8282-afac35a2a5e4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.540843 May 11 21:07:41.740247 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 205/424] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:41 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:41.918364 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:41.940006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-47d177e3-1ae5-4421-a5d1-293dcf217ab1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.647292 May 11 21:07:41.951968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 220/425] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:41 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:42.780914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:42.780914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:42.805201 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:42.812893 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:42.827730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:42.829916 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:42.959448 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:42.960185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:42.989269 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:42.996024 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:42.997182 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:43.004822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:43.181493 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:43.225047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:43.234956 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:43.237601 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2aaf16a4-1010-4eb0-ba04-c0b9a0d0671c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.466576 May 11 21:07:43.244239 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 206/426] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:42 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:43.448687 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:43.472913 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-81619a93-ce85-4c1f-89d1-866383472f3b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.517827 May 11 21:07:43.474658 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 221/427] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:42 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:44.263290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:44.264002 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:44.273594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:44.274420 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:44.275587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:44.276200 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:44.498908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:44.500295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:44.507793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:44.510833 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:44.510833 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:44.510833 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:44.535405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:44.552818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:44.552818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:44.552818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-54f51d41-b1c6-4b4a-985b-cf8909476331 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.289492 May 11 21:07:44.553193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 207/428] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:44 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:44.759730 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:44.768482 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6d238070-e67b-4824-804f-67bffb360757 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.274382 May 11 21:07:44.769689 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 222/429] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:44 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:45.569099 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:45.569871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:45.585818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:45.586823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:45.588268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:45.589206 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:45.769685 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:45.786168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:45.786862 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:45.789925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:45.791893 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:45.793325 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-edac1aa8-d2ab-4a53-8922-5b3cc6f399c9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.229442 May 11 21:07:45.796001 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:45.797476 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:45.798548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:45.799135 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:45.805091 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 208/430] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:45 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:07:45.996452 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:46.005988 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-01312b3a-4422-4eba-9c83-9690c09e96b9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.223465 May 11 21:07:46.006855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 223/431] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:45 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:46.813195 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:46.813913 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:46.821082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:46.821786 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:46.822327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:46.823015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:47.026316 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:47.027088 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:47.034837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:47.038367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:47.042027 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:47.042490 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:47.079622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:47.102535 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:47.103939 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:47.105107 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5680d513-43cc-49a8-927d-36e4d1a95776 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.296499 May 11 21:07:47.108733 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 209/432] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:46 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:47.212693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:47.221422 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d89d67c6-563a-4ebb-a450-d6e71b65e7ff tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.200953 May 11 21:07:47.222018 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 224/433] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:47 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:07:48.128750 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:48.129324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:48.136536 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:48.137260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:48.138629 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:48.139222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:48.241147 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:48.241930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:48.257460 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:48.259798 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:48.264272 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:48.264993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:48.387518 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:48.404653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:48.406514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:48.407970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2da0b29a-1e63-4f98-afe0-c55df4e320a7 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.285450 May 11 21:07:48.411650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 210/434] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:48 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:48.549278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:48.558055 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3bfb7bb0-da58-4742-b0a2-9954c52af10f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.322039 May 11 21:07:48.558636 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 225/435] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:48 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:49.434116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:49.434904 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:49.441895 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:49.442360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:49.443349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:49.443801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:49.576378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:49.577013 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:49.580985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:49.583653 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:49.584114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:49.585073 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:49.587459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:49.591394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:49.593059 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:49.594503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8445557b-a738-4a6a-98af-614e0d081586 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.164393 May 11 21:07:49.608285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 211/436] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:49 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:49.732596 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:49.741594 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-701d342e-42a0-4ac1-a72e-7196a47847ed tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.169091 May 11 21:07:49.742229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 226/437] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:49 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:50.613848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:50.614588 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:50.621319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:50.621783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:50.622599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:50.623236 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:50.760684 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:50.761278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:50.768628 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:50.769562 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:50.771605 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:50.772253 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:50.805652 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:50.814699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:50.817489 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:50.822114 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-07eff7aa-b442-4724-ac92-e7d0d08a5b5e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.210841 May 11 21:07:50.830095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 212/438] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:50 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:50.926027 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:50.935431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1757884e-a04e-49ff-bd35-d888ec3ef03d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1501 microversion: 2.1 time: 0.179029 May 11 21:07:50.936051 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 227/439] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:50 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:50.952657 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29a0e3c5-2a7e-485e-b682-ddd4d2add4b4"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:50.953888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:50.960739 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:50.961214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:50.962021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:50.962453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:50.986842 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] HTTP exception thrown: Cannot 'attach_volume' instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b while it is in vm_state rescued May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Request method failure captured: May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b/os-volume_attachments HTTP/1.1 May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 74 May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCU-pZ8tTrn9OY2Wc4uDkMAlSJqVCr0KLJNOPdapQhLJnNgi_BS7FnKDFSmdGsxSkqXTmNbCv3QEP91gQC6euwQlfmKwCri1evt8cU_1IjIFdX0DbxC6AzKqf9D-w1wqg2naT3dlzBmznTHUWI1p14O6BzSFn-_y1NdwMhiZ9fKOshk May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:07:50.988585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/838ec035db164e50bc335d2cf141d943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_838ec035db164e50bc335d2cf141d943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: df9d6a9b73e64e31b014b5809912bbe8 May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {"volumeAttachment": {"volumeId": "29a0e3c5-2a7e-485e-b682-ddd4d2add4b4"}} May 11 21:07:50.990149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Cannot 'attach_volume' instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b while it is in vm_state rescued May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'server_id': 'a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b', 'body': {'volumeAttachment': {'volumeId': '29a0e3c5-2a7e-485e-b682-ddd4d2add4b4'}}} May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b in vm_state rescued. Cannot attach_volume while the instance is in this state. May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:07:50.990992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b while it is in vm_state rescued May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:07:50.992666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:07:50.994216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:07:50.994216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:07:50.994216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b while it is in vm_state rescued May 11 21:07:50.994216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:07:50.994216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Returning 409 to user: Cannot 'attach_volume' instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b while it is in vm_state rescued {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:07:50.994216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9ec558ae-2bab-40c3-878e-05b609d2ac72 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041560 May 11 21:07:50.994216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 213/440] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:07:50 2022] POST /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 21:07:50.998993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ec828f76-64af-4ced-9062-3c3b23c21810 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:50.999573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ec828f76-64af-4ced-9062-3c3b23c21810 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:51.005982 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec828f76-64af-4ced-9062-3c3b23c21810 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:51.006543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec828f76-64af-4ced-9062-3c3b23c21810 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:51.007563 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec828f76-64af-4ced-9062-3c3b23c21810 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:51.008068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec828f76-64af-4ced-9062-3c3b23c21810 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:51.281361 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ec828f76-64af-4ced-9062-3c3b23c21810 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b/action" status: 202 len: 0 microversion: 2.1 time: 0.285364 May 11 21:07:51.282143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 228/441] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:07:50 2022] POST /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:07:51.290516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:51.291417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:51.297868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:51.298565 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:51.299392 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:51.300002 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:51.457972 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:51.471673 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-84ecdcc0-5496-4174-a920-63a6b2eda095 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1509 microversion: 2.1 time: 0.181915 May 11 21:07:51.471673 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 214/442] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:51 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:51.851873 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:51.853305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:51.860732 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:51.861468 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:51.862501 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:51.863238 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:52.005391 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:52.014464 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:52.016554 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:52.017719 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7e91b728-47a1-406d-bafa-094cf537e270 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.171077 May 11 21:07:52.018266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 229/443] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:51 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:52.493254 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:52.493995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:52.502174 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:52.502974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:52.504279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:52.504923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:52.704745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:52.712820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-276f8ac3-444c-41ef-8914-3a51e6c1d131 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1509 microversion: 2.1 time: 0.226934 May 11 21:07:52.713966 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 215/444] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:52 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:53.043657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:53.044381 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:53.054068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:53.055399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:53.056510 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:53.056983 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:53.241715 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:53.250799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:53.252315 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:53.253677 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5ca3a9ea-284f-4169-bfbb-77a6ae45ab7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.219269 May 11 21:07:53.254255 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 230/445] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:53 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:53.731745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:53.732350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:53.739307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:53.739643 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:53.740417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:53.740870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:53.910859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:53.919274 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6d9b9438-1290-4ef7-9308-5e18a2810678 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1509 microversion: 2.1 time: 0.191264 May 11 21:07:53.920307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 216/446] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:53 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:54.272219 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:54.272823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:54.278838 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:54.279283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:54.280102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:54.280539 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:54.429966 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:54.439562 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:54.441214 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:54.442398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-826f3450-9e70-45b4-bbe7-216f29d0cd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.174271 May 11 21:07:54.442958 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 231/447] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:54 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:07:54.938503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:54.939194 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:54.946305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:54.949009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:54.949009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:54.949009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:55.078110 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:55.085411 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bfabaeac-d14f-4bf1-a8c6-ca130e14bd9e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1509 microversion: 2.1 time: 0.151701 May 11 21:07:55.085993 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 217/448] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:54 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:55.461885 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:55.462499 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:55.469358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:55.470142 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:55.471066 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:55.471643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:55.603536 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:55.612417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:55.613920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:55.615065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6e528c5f-1e0e-4341-98ce-8b27986025f0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.157146 May 11 21:07:55.615618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 232/449] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:55 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:55.719084 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-55f999ac-02a8-443e-bb8c-a7c33f3bfc8f req-0be4cc60-3862-4839-a46c-11558e05e816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e6f4c2-0bcd-4a54-854f-638f98f48a25", "name": "network-vif-plugged", "status": "completed", "tag": "17516495-e3a1-4e3b-9f09-7e6a38573ceb"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:55.727024 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-55f999ac-02a8-443e-bb8c-a7c33f3bfc8f req-0be4cc60-3862-4839-a46c-11558e05e816 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:55.727465 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-55f999ac-02a8-443e-bb8c-a7c33f3bfc8f req-0be4cc60-3862-4839-a46c-11558e05e816 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:55.738124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-55f999ac-02a8-443e-bb8c-a7c33f3bfc8f req-0be4cc60-3862-4839-a46c-11558e05e816 service nova] Creating event network-vif-plugged:17516495-e3a1-4e3b-9f09-7e6a38573ceb for instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 on hv-cinder-84146 May 11 21:07:55.743459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-55f999ac-02a8-443e-bb8c-a7c33f3bfc8f req-0be4cc60-3862-4839-a46c-11558e05e816 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028739 May 11 21:07:55.744034 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 218/450] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:07:56.102550 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:56.103063 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:56.110006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:56.110456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:56.111596 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:56.111697 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:56.243191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:56.250482 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-eedeb989-6452-4fbc-8aea-b1f112183cf1 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1509 microversion: 2.1 time: 0.151958 May 11 21:07:56.251045 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 233/451] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:56 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:56.634089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:56.634778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:56.642119 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:56.642563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:56.643348 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:56.643783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:56.780770 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:56.789856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:56.791614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:56.792886 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3b37c34b-ff61-4fab-a28d-d337633eec24 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.163249 May 11 21:07:56.793469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 219/452] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:56 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:57.268822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:57.269381 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:57.275643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:57.276092 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:57.276881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:57.277315 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:57.412859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:57.420003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d99636dd-d993-4286-88cb-6f8e3dde6d47 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1515 microversion: 2.1 time: 0.155653 May 11 21:07:57.420686 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 234/453] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:07:57 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:07:57.811221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:57.812311 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:57.818642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:57.819095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:57.819879 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:57.820300 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:57.951432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:57.959931 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:57.961407 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:57.964221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9028a609-5d7d-4bba-955f-43ea065d5a45 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.155468 May 11 21:07:57.964221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 220/454] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:57 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:58.984621 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:07:58.985228 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:07:58.993681 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:58.994841 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:58.996190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:07:58.996644 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:07:59.146375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:59.148981 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d5c35318-87ac-4a20-a439-8b3a5a52c4c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'create', calling method: .version_select at 0x7ff8981ae820>, body: {"keypair": {"name": "tempest-keypair-554350879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxBEgwkPEvFjhDTtyCeOaOe4nvbPQDQU4fSj4bvxxHBqzOgfe4/d/I5aiH3WXo2+HWGBZ23jFtudQ4LlK3BFDl3P2aKbKkCLZMyXfqMOUON9U1l10tbILHbZ1mU+bFIgQ=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:07:59.156395 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:59.158391 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:07:59.159790 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a51bc67c-90f9-478d-ae27-cfaa8fb1d7d5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1808 microversion: 2.20 time: 0.183544 May 11 21:07:59.161030 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 235/455] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:07:58 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:07:59.165952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d5c35318-87ac-4a20-a439-8b3a5a52c4c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for project 838ec035db164e50bc335d2cf141d943. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:07:59.169844 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-d5c35318-87ac-4a20-a439-8b3a5a52c4c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for user df9d6a9b73e64e31b014b5809912bbe8 and project 838ec035db164e50bc335d2cf141d943. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:07:59.182134 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d5c35318-87ac-4a20-a439-8b3a5a52c4c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [71c6f054-2433-4fd9-88b0-675ff5d8e3d9] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 11 21:08:00.184511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:00.185129 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:00.190213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [None req-d5c35318-87ac-4a20-a439-8b3a5a52c4c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [71c6f054-2433-4fd9-88b0-675ff5d8e3d9] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 51870. May 11 21:08:00.191725 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:00.192180 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:00.192953 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:00.193391 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:00.278397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d5c35318-87ac-4a20-a439-8b3a5a52c4c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.133323 May 11 21:08:00.279728 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 221/456] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:07:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:00.327545 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:00.338257 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:00.339783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:00.340925 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fe7f6550-ed00-48dd-b682-4b34a66b3764 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1795 microversion: 2.20 time: 0.160556 May 11 21:08:00.341489 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 236/457] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:08:00 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:08:02.798834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1812119994", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9807f35-125b-48ae-9b3f-337b199ffd2c"}], "security_groups": [{"name": "tempest-securitygroup--2077974270"}], "key_name": "tempest-keypair-554350879", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:02.897636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] validate_networks() for [('a9807f35-125b-48ae-9b3f-337b199ffd2c', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:08:03.262059 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:08:03.262480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:08:03.262946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:08:03.263352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:08:03.263778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:08:03.273456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:03.273987 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:03.274793 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:03.275231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:03.291772 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for project 838ec035db164e50bc335d2cf141d943. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:08:03.295593 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Getting quotas for user df9d6a9b73e64e31b014b5809912bbe8 and project 838ec035db164e50bc335d2cf141d943. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:08:03.306163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:08:03.308424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:08:03.457015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5ab4cfc6-b3ad-4ea4-8978-30e850685725 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.662671 May 11 21:08:03.457714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 222/458] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:08:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 21:08:03.467573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-84fda785-8dc2-40ed-b0d8-2a8483053411 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:03.468210 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-84fda785-8dc2-40ed-b0d8-2a8483053411 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:03.520184 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-84fda785-8dc2-40ed-b0d8-2a8483053411 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:03.527260 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-84fda785-8dc2-40ed-b0d8-2a8483053411 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1245 microversion: 2.1 time: 0.063519 May 11 21:08:03.527838 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 237/459] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:03 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1245 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:04.545317 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:04.545943 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:04.554524 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:04.554991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:04.555769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:04.556205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:04.616479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:04.624092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e4f93a46-53e7-41c2-bc35-834e282f31b8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1249 microversion: 2.1 time: 0.082548 May 11 21:08:04.625192 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 223/460] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:04 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:05.641597 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:05.642202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:05.648485 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:05.648939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:05.649773 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:05.650551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:05.967704 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:05.974993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-474d724b-140e-4b30-a416-8614c7bab87d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1297 microversion: 2.1 time: 0.337921 May 11 21:08:05.975751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 238/461] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:05 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1297 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:06.997442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:06.998651 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:07.004868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:07.005314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:07.006117 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:07.006550 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:07.136575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:07.147348 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a9c6c16f-7f35-4880-8dbb-28422770e45d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.153760 May 11 21:08:07.147998 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 224/462] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:06 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:07.752455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-ad432983-b7d8-4cc4-a288-4150504376e5 req-826f921f-364c-48e4-a4b1-c3e069759ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa6104-9267-474c-aa59-3e38d5636e78", "tag": "aa313336-1ef9-41c8-900a-4471c553fd70"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:07.761418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-ad432983-b7d8-4cc4-a288-4150504376e5 req-826f921f-364c-48e4-a4b1-c3e069759ba2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:07.761895 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-ad432983-b7d8-4cc4-a288-4150504376e5 req-826f921f-364c-48e4-a4b1-c3e069759ba2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:07.776029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-ad432983-b7d8-4cc4-a288-4150504376e5 req-826f921f-364c-48e4-a4b1-c3e069759ba2 service nova] Creating event network-changed:aa313336-1ef9-41c8-900a-4471c553fd70 for instance 6afa6104-9267-474c-aa59-3e38d5636e78 on hv-cinder-84146 May 11 21:08:07.780984 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-ad432983-b7d8-4cc4-a288-4150504376e5 req-826f921f-364c-48e4-a4b1-c3e069759ba2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033065 May 11 21:08:07.781612 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 239/463] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:08.094630 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-291889410", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320302024", "security_groups": [{"name": "tempest-secgroup-smoke-644581309"}], "block_device_mapping_v2": [{"uuid": "1298740b-340e-4057-9a56-c005f9b5ec9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8d33d52-b2cd-4098-87c1-78268014f2dc"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:08.165579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:08.166370 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:08.173082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:08.173633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:08.174460 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:08.174958 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:08.214149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] validate_networks() for [('c8d33d52-b2cd-4098-87c1-78268014f2dc', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:08:08.399053 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:08.407512 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b306bc11-8943-4a8a-a321-888abbe8c20f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.246008 May 11 21:08:08.408312 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 240/464] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:08 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:08.797707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:08:08.798129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:08:08.798599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:08:08.799004 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:08:08.799412 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:08:08.807751 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:08.808197 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:08.808993 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:08.809429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:08.825718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:08:08.829621 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for user 3a47bfbd0a2e459cabaa30d74f45811a and project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:08:08.885372 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:08:08.887405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1298740b-340e-4057-9a56-c005f9b5ec9d',volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:08:09.384040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bcb4ef3b-9434-471b-9698-4463673c0c1f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.293860 May 11 21:08:09.385295 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 225/465] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:08:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:08:09.395356 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a4afcaf4-d310-4981-9e61-d077c984b57e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:09.396815 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a4afcaf4-d310-4981-9e61-d077c984b57e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:09.424692 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:09.429772 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:09.438335 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:09.438892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:09.439778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:09.440423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:09.455665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a4afcaf4-d310-4981-9e61-d077c984b57e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:09.462775 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a4afcaf4-d310-4981-9e61-d077c984b57e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1094 microversion: 2.1 time: 0.071470 May 11 21:08:09.463338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 241/466] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:09 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:09.573700 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:09.581829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-40fba362-416a-4dab-a75b-a48c5dc47a09 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.161004 May 11 21:08:09.582389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 226/467] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:09 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:10.487671 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b793f844-c415-4dcb-83dc-af3ded30049f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:10.487671 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b793f844-c415-4dcb-83dc-af3ded30049f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:10.535491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b793f844-c415-4dcb-83dc-af3ded30049f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:10.539599 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b793f844-c415-4dcb-83dc-af3ded30049f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1094 microversion: 2.1 time: 0.064023 May 11 21:08:10.540160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 242/468] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:10 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:10.599227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:10.599838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:10.606473 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:10.606978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:10.607776 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:10.608213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:10.740952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:10.749378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3261a5c8-2041-4bb4-b62c-3f4ce59d5cd4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.153962 May 11 21:08:10.749986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 227/469] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:10 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:11.512125 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4ec41dc4-d908-48c9-9890-13f91177ac9d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:11.512629 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4ec41dc4-d908-48c9-9890-13f91177ac9d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:11.518527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ec41dc4-d908-48c9-9890-13f91177ac9d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.519027 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ec41dc4-d908-48c9-9890-13f91177ac9d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.519858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ec41dc4-d908-48c9-9890-13f91177ac9d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.520291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4ec41dc4-d908-48c9-9890-13f91177ac9d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.543148 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4ec41dc4-d908-48c9-9890-13f91177ac9d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c/ips" status: 200 len: 149 microversion: 2.1 time: 0.034739 May 11 21:08:11.547841 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 243/470] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:08:11 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:11.555575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a56b471a-e4d9-4f15-9ccf-d3d313e6754f"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:11.555958 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:11.556601 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:11.556718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:11.563247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.563430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.563700 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.563808 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.564457 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.564582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.564881 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.564987 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.634673 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:11.637585 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ddf14475-bfb5-4d1f-b3f2-cbdb40b9b5ea tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1192 microversion: 2.1 time: 0.085418 May 11 21:08:11.638142 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 244/471] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:11 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:11.649288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Invalid volume: volume a56b471a-e4d9-4f15-9ccf-d3d313e6754f is already attached to instances: b8a0c714-2a75-4c5a-b97c-bd3407687b16 May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c/os-volume_attachments HTTP/1.1 May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 74 May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:08:11.657675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {"volumeAttachment": {"volumeId": "a56b471a-e4d9-4f15-9ccf-d3d313e6754f"}} May 11 21:08:11.659871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Invalid volume: volume a56b471a-e4d9-4f15-9ccf-d3d313e6754f is already attached to instances: b8a0c714-2a75-4c5a-b97c-bd3407687b16 May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'server_id': '4d723bfd-a4d6-44d4-8910-f88e2b7b395c', 'body': {'volumeAttachment': {'volumeId': 'a56b471a-e4d9-4f15-9ccf-d3d313e6754f'}}} May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a56b471a-e4d9-4f15-9ccf-d3d313e6754f is already attached to instances: b8a0c714-2a75-4c5a-b97c-bd3407687b16 May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:11.660711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a56b471a-e4d9-4f15-9ccf-d3d313e6754f is already attached to instances: b8a0c714-2a75-4c5a-b97c-bd3407687b16 May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:11.662323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a56b471a-e4d9-4f15-9ccf-d3d313e6754f is already attached to instances: b8a0c714-2a75-4c5a-b97c-bd3407687b16 May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 400 to user: Invalid volume: volume a56b471a-e4d9-4f15-9ccf-d3d313e6754f is already attached to instances: b8a0c714-2a75-4c5a-b97c-bd3407687b16 {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2b67e9d7-5824-4edd-81d6-ca0d322aff06 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102166 May 11 21:08:11.663846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 228/472] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:08:11 2022] POST /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 21:08:11.669471 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:11.669983 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:11.677198 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.677960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.678726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.679426 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.704477 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:08:11.770382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:11.771077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:11.778912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.779409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.780313 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:11.781508 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:11.935277 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:11.943523 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-43fcc8f4-3e9c-4fb4-946f-901336ba90c7 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.178470 May 11 21:08:11.944427 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 229/473] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:11 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:12.034941 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a0f045fd-13ef-4699-852c-d8dfaa0a6288 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 204 len: 0 microversion: 2.1 time: 0.369089 May 11 21:08:12.036143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 245/474] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:08:11 2022] DELETE /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:08:12.044662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:12.045354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:12.053573 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:12.053573 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:12.053573 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:12.054015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:12.190071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:12.197477 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3213708b-69cf-49f2-b889-12afe3a09497 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1681 microversion: 2.1 time: 0.156963 May 11 21:08:12.198332 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 230/475] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:12 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:12.657095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:12.658488 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:12.664681 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:12.665128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:12.667225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:12.667225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:12.815267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:12.823498 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d31afe68-44d7-4d07-935c-443026501f3c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1277 microversion: 2.1 time: 0.170684 May 11 21:08:12.824176 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 246/476] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:12 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:12.960072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:12.960711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:12.967121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:12.967575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:12.968379 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:12.969000 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:13.096379 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:13.103758 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ba1b09b6-e97a-447a-9175-546db623cd87 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.147526 May 11 21:08:13.104324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 231/477] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:12 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:13.215080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:13.215715 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:13.221697 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:13.222147 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:13.222904 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:13.223335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:13.350515 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:13.357813 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-491dfa48-0883-4500-82f8-bc26672444f0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1681 microversion: 2.1 time: 0.146627 May 11 21:08:13.358376 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 247/478] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:13 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:13.840469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:13.841096 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:13.849157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:13.849599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:13.851014 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:13.851613 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:13.984308 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-5e0b7a6d-20e1-494b-a048-2ae02221fe66 req-64cd642e-f49c-4486-b4d2-2915c570567b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa6104-9267-474c-aa59-3e38d5636e78", "name": "network-vif-plugged", "status": "completed", "tag": "aa313336-1ef9-41c8-900a-4471c553fd70"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:13.995215 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5e0b7a6d-20e1-494b-a048-2ae02221fe66 req-64cd642e-f49c-4486-b4d2-2915c570567b service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:13.995789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5e0b7a6d-20e1-494b-a048-2ae02221fe66 req-64cd642e-f49c-4486-b4d2-2915c570567b service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:14.007999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:14.008567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-5e0b7a6d-20e1-494b-a048-2ae02221fe66 req-64cd642e-f49c-4486-b4d2-2915c570567b service nova] Creating event network-vif-plugged:aa313336-1ef9-41c8-900a-4471c553fd70 for instance 6afa6104-9267-474c-aa59-3e38d5636e78 on hv-cinder-84146 May 11 21:08:14.013785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-5e0b7a6d-20e1-494b-a048-2ae02221fe66 req-64cd642e-f49c-4486-b4d2-2915c570567b service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 May 11 21:08:14.014523 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 248/479] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:14.016636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f73754e1-aff5-4e63-bf2f-1eec79622a15 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1277 microversion: 2.1 time: 0.180302 May 11 21:08:14.017455 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 232/480] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:13 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:14.122235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:14.123775 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:14.139542 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:14.153202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:14.153202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:14.153202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:14.376252 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:14.376888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:14.391670 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:14.392117 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:14.393445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:14.393993 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:14.548426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:14.556005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-09859ab2-e480-4d54-93d9-54aca852bf2c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1681 microversion: 2.1 time: 0.184690 May 11 21:08:14.557076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 233/481] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:14 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:14.573315 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:14.580836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-febc16bd-2c3a-4fbb-a00f-fcccf18e4ec5 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.463231 May 11 21:08:14.581405 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 249/482] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:14 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:14.862007 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-e0809a2e-20e5-4c88-beb4-2991fcd01bf5 req-1a4284bc-f7df-49b6-a557-ad7481d68929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3855665-64e1-4b51-9e7b-a46354bde903", "tag": "e2cb6f2a-c41b-40ff-8244-7d1958f2b07e"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:14.869979 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e0809a2e-20e5-4c88-beb4-2991fcd01bf5 req-1a4284bc-f7df-49b6-a557-ad7481d68929 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:14.870537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e0809a2e-20e5-4c88-beb4-2991fcd01bf5 req-1a4284bc-f7df-49b6-a557-ad7481d68929 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:14.884672 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-e0809a2e-20e5-4c88-beb4-2991fcd01bf5 req-1a4284bc-f7df-49b6-a557-ad7481d68929 service nova] Creating event network-changed:e2cb6f2a-c41b-40ff-8244-7d1958f2b07e for instance b3855665-64e1-4b51-9e7b-a46354bde903 on hv-cinder-84146 May 11 21:08:14.889878 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-e0809a2e-20e5-4c88-beb4-2991fcd01bf5 req-1a4284bc-f7df-49b6-a557-ad7481d68929 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032331 May 11 21:08:14.890901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 234/483] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:15.034855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:15.036114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:15.045924 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:15.047375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:15.048071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:15.048606 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:15.425543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:15.433235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-27d772c7-a1f9-4219-8ceb-d63e7df6474f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1277 microversion: 2.1 time: 0.403909 May 11 21:08:15.443145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 250/484] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:15 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1277 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:15.575148 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:15.576730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:15.586276 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:15.587003 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:15.588081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:15.588724 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:15.598291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:15.598909 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:15.607119 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:15.607574 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:15.608368 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:15.610327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:15.698956 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:15.710138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-afb24d46-3bff-40a1-a0dc-3fb6bd347e91 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1613 microversion: 2.1 time: 0.138780 May 11 21:08:15.722166 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 235/485] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:15 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1613 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:15.920387 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:15.936221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e374d1cd-f529-4724-b3ce-042e596cb0f3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1371 microversion: 2.1 time: 0.341941 May 11 21:08:15.938519 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 251/486] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:15 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:16.450511 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:16.451316 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:16.460522 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.460522 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:16.460764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.461463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:16.650616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:16.659272 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f8554e90-705c-4991-af5c-f8373cd2f648 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.212593 May 11 21:08:16.669275 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 236/487] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:16 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:16.733707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:16.745767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:16.753072 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.753521 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:16.754517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.754997 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:16.788722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.789860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:16.790007 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lazy-loading 'fault' on Instance uuid 4d723bfd-a4d6-44d4-8910-f88e2b7b395c {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:08:16.834799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:16.842855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2df2f9b0-9a07-48f4-8ff2-7a4ac65fb758 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 200 len: 1331 microversion: 2.1 time: 0.118421 May 11 21:08:16.845676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 252/488] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:16 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:16.905015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-a3da5115-24ae-4d16-b845-774181a659f1 req-fa6a2fea-31a9-4652-a776-75d054ef1d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d723bfd-a4d6-44d4-8910-f88e2b7b395c", "name": "network-vif-deleted", "tag": "33495938-b6a2-44d1-a611-20bc7a6ee31c"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:16.913343 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-a3da5115-24ae-4d16-b845-774181a659f1 req-fa6a2fea-31a9-4652-a776-75d054ef1d6f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.913823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-a3da5115-24ae-4d16-b845-774181a659f1 req-fa6a2fea-31a9-4652-a776-75d054ef1d6f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:16.928828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-a3da5115-24ae-4d16-b845-774181a659f1 req-fa6a2fea-31a9-4652-a776-75d054ef1d6f service nova] Creating event network-vif-deleted:33495938-b6a2-44d1-a611-20bc7a6ee31c for instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c on hv-cinder-84146 May 11 21:08:16.933822 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-a3da5115-24ae-4d16-b845-774181a659f1 req-fa6a2fea-31a9-4652-a776-75d054ef1d6f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032525 May 11 21:08:16.934419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 237/489] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:16.954572 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:16.955479 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:16.964331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.964799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:16.965631 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:16.966107 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:17.168580 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:17.176838 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1a7457af-ed7a-4737-8a9b-4cd88242c7b2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1565 microversion: 2.1 time: 0.226036 May 11 21:08:17.184448 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 253/490] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:16 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1565 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:17.193951 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f25f3a0a-1dd3-45f2-a942-bc41d6d65705 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:17.195039 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f25f3a0a-1dd3-45f2-a942-bc41d6d65705 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:17.201205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f25f3a0a-1dd3-45f2-a942-bc41d6d65705 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:17.201780 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f25f3a0a-1dd3-45f2-a942-bc41d6d65705 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:17.203465 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f25f3a0a-1dd3-45f2-a942-bc41d6d65705 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:17.203980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f25f3a0a-1dd3-45f2-a942-bc41d6d65705 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:17.285057 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f25f3a0a-1dd3-45f2-a942-bc41d6d65705 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095474 May 11 21:08:17.285865 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 238/491] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:08:17 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:17.680107 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:17.680730 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:17.687986 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:17.688432 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:17.689224 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:17.689693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:17.835840 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:17.844285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8d4ef1f7-1fb7-4961-b1a5-bd8b69a4b152 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.168214 May 11 21:08:17.845067 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 254/492] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:17 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:17.862945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:17.863919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:17.871947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:17.872475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:17.873257 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:17.873730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:17.888072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c HTTP/1.1 May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:08:17.890314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:08:17.891819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '4d723bfd-a4d6-44d4-8910-f88e2b7b395c'} May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:08:17.892819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:08:17.894319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:17.896493 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:08:17.899135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-81ebf783-6b9e-4fa2-99ca-201ccaab8a72 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 404 len: 111 microversion: 2.1 time: 0.039904 May 11 21:08:17.900319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 239/493] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:17 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:08:17.913253 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-23d16b43-c32f-48ec-9808-9d7dcfd3d260 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '.version_select at 0x7ff898292e50>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:18.002061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-23d16b43-c32f-48ec-9808-9d7dcfd3d260 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136735027" status: 202 len: 0 microversion: 2.1 time: 0.097083 May 11 21:08:18.002821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 255/494] 10.222.0.35 () {58 vars in 1220 bytes} [Wed May 11 21:08:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136735027 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:08:18.480647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-ebe7ec4a-e8a3-477b-9eae-ba48e8653dca req-238d7894-c339-4fce-8cc9-66e2ea53526d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa6104-9267-474c-aa59-3e38d5636e78", "tag": "aa313336-1ef9-41c8-900a-4471c553fd70"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:18.492743 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ebe7ec4a-e8a3-477b-9eae-ba48e8653dca req-238d7894-c339-4fce-8cc9-66e2ea53526d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:18.493650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ebe7ec4a-e8a3-477b-9eae-ba48e8653dca req-238d7894-c339-4fce-8cc9-66e2ea53526d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:18.512844 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-ebe7ec4a-e8a3-477b-9eae-ba48e8653dca req-238d7894-c339-4fce-8cc9-66e2ea53526d service nova] Creating event network-changed:aa313336-1ef9-41c8-900a-4471c553fd70 for instance 6afa6104-9267-474c-aa59-3e38d5636e78 on hv-cinder-84146 May 11 21:08:18.519113 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-ebe7ec4a-e8a3-477b-9eae-ba48e8653dca req-238d7894-c339-4fce-8cc9-66e2ea53526d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042224 May 11 21:08:18.520778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 240/495] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:18.861016 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:18.861768 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:18.868414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:18.869003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:18.869902 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:18.870429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:19.105691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:19.119146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-335b95a4-82eb-4abb-9021-0c1c18a10e7a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.262652 May 11 21:08:19.129238 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 256/496] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:18 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:19.293371 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:19.294038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:19.300545 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:19.300991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:19.301807 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:19.302238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:19.437919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lazy-loading 'services' on Instance uuid b8a0c714-2a75-4c5a-b97c-bd3407687b16 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:08:19.696022 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6d5bb483-a2e8-4081-9db6-cc11a73a0391 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments/a56b471a-e4d9-4f15-9ccf-d3d313e6754f" status: 202 len: 0 microversion: 2.1 time: 0.407194 May 11 21:08:19.696706 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 241/497] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:08:19 2022] DELETE /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments/a56b471a-e4d9-4f15-9ccf-d3d313e6754f => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:08:19.705111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6c299979-d643-4d61-a1aa-1656fea5f54f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:19.706175 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6c299979-d643-4d61-a1aa-1656fea5f54f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:19.712304 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c299979-d643-4d61-a1aa-1656fea5f54f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:19.712844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c299979-d643-4d61-a1aa-1656fea5f54f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:19.713705 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c299979-d643-4d61-a1aa-1656fea5f54f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:19.714286 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6c299979-d643-4d61-a1aa-1656fea5f54f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:19.742752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6c299979-d643-4d61-a1aa-1656fea5f54f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041638 May 11 21:08:19.743295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 257/498] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:08:19 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:20.137019 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:20.137664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:20.143710 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:20.144148 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:20.144902 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:20.145330 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:20.276773 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:20.284600 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a8255acd-749b-4b20-a3b4-0b5551f2a5b5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.151867 May 11 21:08:20.285160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 242/499] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:20 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:20.755069 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1e382e1d-43dd-4bf8-a7aa-5b7d82bf0aa0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:20.756090 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1e382e1d-43dd-4bf8-a7aa-5b7d82bf0aa0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:20.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1e382e1d-43dd-4bf8-a7aa-5b7d82bf0aa0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:20.762455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1e382e1d-43dd-4bf8-a7aa-5b7d82bf0aa0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:20.763200 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1e382e1d-43dd-4bf8-a7aa-5b7d82bf0aa0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:20.763641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1e382e1d-43dd-4bf8-a7aa-5b7d82bf0aa0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:20.793827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1e382e1d-43dd-4bf8-a7aa-5b7d82bf0aa0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042860 May 11 21:08:20.794388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 258/500] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:08:20 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:21.301402 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:21.302046 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:21.308312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:21.308760 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:21.309543 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:21.309983 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:21.436155 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:21.443470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-23f72f1f-ecbc-4711-80af-6da6bc6a691a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.146460 May 11 21:08:21.444030 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 243/501] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:21 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:21.805280 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d0483e38-82cb-4824-b8bc-bb4ecdd81916 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:21.806227 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d0483e38-82cb-4824-b8bc-bb4ecdd81916 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:21.811958 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0483e38-82cb-4824-b8bc-bb4ecdd81916 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:21.812404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0483e38-82cb-4824-b8bc-bb4ecdd81916 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:21.813224 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0483e38-82cb-4824-b8bc-bb4ecdd81916 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:21.813738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d0483e38-82cb-4824-b8bc-bb4ecdd81916 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:21.842979 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d0483e38-82cb-4824-b8bc-bb4ecdd81916 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040388 May 11 21:08:21.845702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 259/502] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:08:21 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:08:21.904312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:21.904838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:21.911317 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:21.911837 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:21.912601 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:21.913037 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:21.937130 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:08:22.370618 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-50643755-8c1e-427a-8814-c3c1f33f8f3d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 204 len: 0 microversion: 2.1 time: 0.469916 May 11 21:08:22.371316 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 244/503] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:08:21 2022] DELETE /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:08:22.380031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:22.380640 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:22.386837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:22.387321 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:22.388095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:22.388532 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:22.461115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:22.461976 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:22.467944 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:22.468453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:22.469168 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:22.469636 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:22.517472 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:22.525086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-acd4603a-2528-428d-bae8-2392e56f2536 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1677 microversion: 2.1 time: 0.149568 May 11 21:08:22.525676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 260/504] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:22 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:22.600047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:22.607379 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4bfb062b-e9c1-450d-b4b1-c00f7e40511d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.150596 May 11 21:08:22.607950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 245/505] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:22 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:23.541760 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:23.542407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:23.548233 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:23.548675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:23.549429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:23.549882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:23.624660 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:23.625267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:23.631515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:23.631962 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:23.632726 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:23.633159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:23.676706 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:23.684108 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-654e73f7-b613-4beb-84e4-d91da0f0f3ef tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1677 microversion: 2.1 time: 0.146238 May 11 21:08:23.684670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 261/506] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:23 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:23.760555 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:23.768348 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5aab2b2d-31ed-4962-a353-61b8f6e9790e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.147503 May 11 21:08:23.768902 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 246/507] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:23 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:24.702202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:24.702717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:24.709194 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:24.709668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:24.710418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:24.710845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:24.784356 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:24.784963 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:24.791450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:24.791898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:24.792653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:24.793094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:24.840985 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:24.849115 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e43caa40-021d-473a-8adb-533ae441722b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1677 microversion: 2.1 time: 0.150735 May 11 21:08:24.849749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 262/508] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:24 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:24.922709 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:24.929818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-757a4f7f-f3d0-4a37-8fef-60e7c436754e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.149742 May 11 21:08:24.930381 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 247/509] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:24 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:25.564574 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:25.565076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:25.571003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:25.571445 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:25.572191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:25.572620 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:25.691296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lazy-loading 'services' on Instance uuid 925e3d97-64b1-4637-9850-0c37d5f2a870 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:08:25.865906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:25.866510 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:25.872671 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:25.873112 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:25.873893 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:25.874319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:25.964392 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ca142c00-333d-4a65-bd46-ee0d89c721fe tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-volume_attachments/eb4215eb-fd86-4649-a722-d235ac25fe1c" status: 202 len: 0 microversion: 2.1 time: 0.404274 May 11 21:08:25.965046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 263/510] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:08:25 2022] DELETE /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-volume_attachments/eb4215eb-fd86-4649-a722-d235ac25fe1c => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:08:25.970715 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:25.971399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:25.977494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:25.977976 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:25.978741 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:25.979174 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:26.006846 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:26.014946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-550978cd-dda4-4577-9dfb-6c153924c8be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1677 microversion: 2.1 time: 0.152839 May 11 21:08:26.015557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 248/511] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:25 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:26.105308 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:26.113017 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6d3cbf1b-e943-49d1-8a11-01d37c768a5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.146932 May 11 21:08:26.113588 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 264/512] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:25 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:27.032643 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:27.033287 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:27.039759 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:27.040216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:27.040991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:27.041428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:27.129752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:27.130450 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:27.136255 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:27.136779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:27.137702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:27.138212 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:27.167179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:27.175531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a0ba5823-0735-4773-8ebb-75e8ed03e44c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1677 microversion: 2.1 time: 0.147106 May 11 21:08:27.176125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 249/513] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:27 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:27.270969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:27.278548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c1170ec0-ed64-415e-a315-2afcba9f9103 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.153225 May 11 21:08:27.279107 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 265/514] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:27 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:28.192475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:28.193127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:28.199410 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:28.199851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:28.200602 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:28.201030 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:28.294739 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:28.295327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:28.301198 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:28.304999 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:28.304999 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:28.304999 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:28.329811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:28.337046 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-da0caac2-00ca-4d7c-b6fc-7b90a0f194e8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1677 microversion: 2.1 time: 0.148350 May 11 21:08:28.341668 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 250/515] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:28 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:28.515466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:28.524133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7d405cae-2b74-455a-ab5f-08fd716167a4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.233044 May 11 21:08:28.524943 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 266/516] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:28 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:29.187063 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-958ff8b8-4c85-4446-947e-04f55f80f92a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:29.192837 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-958ff8b8-4c85-4446-947e-04f55f80f92a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.198080 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-958ff8b8-4c85-4446-947e-04f55f80f92a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.251770 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-958ff8b8-4c85-4446-947e-04f55f80f92a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Going to try to stop instance {{(pid=117612) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 21:08:29.357913 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:29.360236 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:29.366974 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.370324 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.370324 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.370324 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.435801 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:29.443106 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4c580778-9e7c-4b24-a6ee-8c1c138351bf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1610 microversion: 2.1 time: 0.090180 May 11 21:08:29.444005 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 267/517] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:29 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1610 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:29.449154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-e6b82648-5f1d-4191-a29b-d38eabeeb3ab req-3131a2e4-91bd-4d53-a113-fbb563abccd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a0c714-2a75-4c5a-b97c-bd3407687b16", "name": "network-vif-deleted", "tag": "b5d7d61f-ac27-420d-a3ea-7fdaecaeed05"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:29.458612 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e6b82648-5f1d-4191-a29b-d38eabeeb3ab req-3131a2e4-91bd-4d53-a113-fbb563abccd8 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.459065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e6b82648-5f1d-4191-a29b-d38eabeeb3ab req-3131a2e4-91bd-4d53-a113-fbb563abccd8 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.472937 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-958ff8b8-4c85-4446-947e-04f55f80f92a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action" status: 202 len: 0 microversion: 2.1 time: 0.289450 May 11 21:08:29.475901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 251/518] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:08:29 2022] POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:08:29.476061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-e6b82648-5f1d-4191-a29b-d38eabeeb3ab req-3131a2e4-91bd-4d53-a113-fbb563abccd8 service nova] Creating event network-vif-deleted:b5d7d61f-ac27-420d-a3ea-7fdaecaeed05 for instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 on hv-cinder-84146 May 11 21:08:29.483537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:29.484237 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:29.496215 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-e6b82648-5f1d-4191-a29b-d38eabeeb3ab req-3131a2e4-91bd-4d53-a113-fbb563abccd8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044869 May 11 21:08:29.498911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 268/519] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:29.503245 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.503653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.504637 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.505226 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.541240 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:29.541971 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:29.554039 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.554822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.555772 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:29.556806 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:29.680288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:29.692152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6da5703a-960c-4836-8466-8505eeba4f62 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.212818 May 11 21:08:29.693741 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 252/520] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:29 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:29.730646 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:29.738019 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-57d4a30d-ee27-4224-8820-ea686433aa90 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.201457 May 11 21:08:29.741786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 269/521] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:29 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:30.461139 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:30.461792 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:30.468702 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:30.469335 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:30.470194 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:30.470633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:30.505858 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:30.506310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:30.506763 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lazy-loading 'fault' on Instance uuid b8a0c714-2a75-4c5a-b97c-bd3407687b16 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:08:30.552249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:30.559723 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ef4caf2c-d10f-4381-8530-31608d5a2969 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 200 len: 1330 microversion: 2.1 time: 0.102428 May 11 21:08:30.560777 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 253/522] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:30 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:30.710613 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:30.711703 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:30.717946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:30.720930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:30.720930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:30.720930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:30.768121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:30.768965 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:30.780374 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:30.784755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:30.785638 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:30.786081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:30.856389 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:30.864279 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8af42fab-1faa-46b2-bbe5-0afaa64abde4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.157484 May 11 21:08:30.864932 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 270/523] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:30 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:30.932349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:30.940421 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9100444a-2069-43e5-a074-8636f9765ee3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.186616 May 11 21:08:30.946705 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 254/524] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:30 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:31.578920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:31.579554 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:31.585651 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:31.586169 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:31.587045 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:31.587486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:31.601120 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 HTTP/1.1 May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:08:31.602752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:08:31.604398 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'b8a0c714-2a75-4c5a-b97c-bd3407687b16'} May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:08:31.605357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:08:31.606920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:08:31.608379 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:08:31.608379 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-efff13c2-406e-48d1-bde3-122789567f6c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 404 len: 111 microversion: 2.1 time: 0.029583 May 11 21:08:31.608379 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 271/525] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:31 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:08:31.612868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5849f8f5-dd20-4ac1-a3f5-c766d63e9905 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '.version_select at 0x7ff8981d0700>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:31.737577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5849f8f5-dd20-4ac1-a3f5-c766d63e9905 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337329189" status: 202 len: 0 microversion: 2.1 time: 0.128313 May 11 21:08:31.738090 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 255/526] 10.222.0.35 () {58 vars in 1217 bytes} [Wed May 11 21:08:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337329189 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 21:08:31.881588 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:31.882190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:31.887843 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:31.889113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:31.889113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:31.889424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:31.957905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:31.958583 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:31.965838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:31.966277 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:31.967060 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:31.967497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:32.035955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:32.043500 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6429ff59-57a7-43e4-b152-079dd8bec75a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.165698 May 11 21:08:32.044068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 272/527] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:31 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:32.224015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:32.231211 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a9f1bca5-5238-4f1d-9da0-b7628c09c97f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.278866 May 11 21:08:32.231767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 256/528] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:31 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:32.654153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fcd89730-1b3c-4f9f-b8c0-6a937ddf5910 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: .version_select at 0x7ff8995d1a60>, body: {"keypair": {"name": "tempest-keypair-789684130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLVQcZLneIZjFYdyT7Zo6w9wsDs0p5CbdLPK/mBnztx0nvdIviSlNbrEckInABVTzlCaeYAg65ywT+5QMnwis5I8DQ44OIBORT1u/A/F6YTNs4vVSdyYPrz9ACB2cM3yw=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:32.668100 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-fcd89730-1b3c-4f9f-b8c0-6a937ddf5910 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:08:32.671882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-fcd89730-1b3c-4f9f-b8c0-6a937ddf5910 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:08:32.754320 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fcd89730-1b3c-4f9f-b8c0-6a937ddf5910 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103999 May 11 21:08:32.754907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 273/529] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:08:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:33.060099 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:33.060707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:33.067124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:33.067574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:33.068331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:33.068782 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:33.197959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:33.207469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8574cdf7-c79c-4242-8ae2-25f6e086175d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.149684 May 11 21:08:33.207469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 257/530] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:33 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:33.246875 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:33.247490 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:33.253340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:33.253831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:33.254622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:33.255060 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:33.385248 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:33.393130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-06ab882e-a5e8-4cf1-a14d-2ea226a6a3f6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.150185 May 11 21:08:33.393704 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 274/531] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:33 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:34.226148 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:34.226148 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:34.230768 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:34.231210 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:34.232147 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:34.232583 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:34.362257 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:34.369455 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-35ea11bd-4c75-4f07-8c7c-7e5314cdf571 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.149660 May 11 21:08:34.370480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 258/532] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:34 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:34.410652 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:34.411244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:34.417657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:34.426327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:34.426327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:34.426327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:34.438698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-3e8d157d-d0f7-4772-8f07-449d7bf2b2b8 req-c80bb6ed-aa6e-4eb2-973b-9700cc4ee1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3855665-64e1-4b51-9e7b-a46354bde903", "name": "network-vif-plugged", "status": "completed", "tag": "e2cb6f2a-c41b-40ff-8244-7d1958f2b07e"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:34.449544 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-3e8d157d-d0f7-4772-8f07-449d7bf2b2b8 req-c80bb6ed-aa6e-4eb2-973b-9700cc4ee1dd service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:34.450097 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-3e8d157d-d0f7-4772-8f07-449d7bf2b2b8 req-c80bb6ed-aa6e-4eb2-973b-9700cc4ee1dd service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:34.462622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-3e8d157d-d0f7-4772-8f07-449d7bf2b2b8 req-c80bb6ed-aa6e-4eb2-973b-9700cc4ee1dd service nova] Creating event network-vif-plugged:e2cb6f2a-c41b-40ff-8244-7d1958f2b07e for instance b3855665-64e1-4b51-9e7b-a46354bde903 on hv-cinder-84146 May 11 21:08:34.467952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-3e8d157d-d0f7-4772-8f07-449d7bf2b2b8 req-c80bb6ed-aa6e-4eb2-973b-9700cc4ee1dd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035209 May 11 21:08:34.469833 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 259/533] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:34.564857 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:34.572844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5850c751-b1d4-4435-b70d-6bfb4f22661f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.166827 May 11 21:08:34.573552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 275/534] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:34 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:35.368532 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1616696454", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d70e35-28da-4d4e-9ed9-625e30aef3e3"}], "security_groups": [{"name": "tempest-securitygroup--1902108884"}], "key_name": "tempest-keypair-789684130", "user_data": "}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:35.387668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:35.387668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:35.393928 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:35.394378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:35.395342 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:35.395781 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:35.469945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] validate_networks() for [('93d70e35-28da-4d4e-9ed9-625e30aef3e3', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:08:35.773749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:35.781130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c77a7d17-bea1-4bb3-b9dd-d831addada1b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.398276 May 11 21:08:35.782266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 276/535] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:35 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:35.786835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:35.787431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:35.794503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:35.798110 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:35.798110 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:35.798110 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:35.851179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:08:35.851633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:08:35.852106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:08:35.852669 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:08:35.853100 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:08:35.862694 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:35.867011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:35.867011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:35.867011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:35.880941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:08:35.884982 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:08:35.896580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:08:35.899224 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:08:35.928807 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:35.936312 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-93b7f4b5-b438-424b-9953-95f892dff9b1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1265 microversion: 2.1 time: 0.153104 May 11 21:08:35.936876 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 277/536] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:35 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:36.012339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3adfb0f7-d465-44aa-b02f-dfa9de1feec0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648741 May 11 21:08:36.012983 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 260/537] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:08:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:08:36.023195 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9acb0b93-5d0f-40fb-bfce-47b00e9ac715 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:36.023797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9acb0b93-5d0f-40fb-bfce-47b00e9ac715 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:36.081403 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9acb0b93-5d0f-40fb-bfce-47b00e9ac715 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:36.088708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9acb0b93-5d0f-40fb-bfce-47b00e9ac715 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1241 microversion: 2.1 time: 0.069627 May 11 21:08:36.089314 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 278/538] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:36 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:36.798924 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:36.799586 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:36.806364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:36.806815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:36.807594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:36.808033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:36.942399 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:36.949792 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-39961d46-02fd-497e-b36e-8b93207036a9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.155257 May 11 21:08:36.950352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 261/539] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:36 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:36.952524 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:36.953133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:36.959569 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:36.962553 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:36.962553 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:36.962553 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:37.093492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:37.101814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5717b7fd-8692-48b4-954e-a3b71ea51609 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1453 microversion: 2.1 time: 0.152938 May 11 21:08:37.102309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 279/540] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:36 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:37.106309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:37.106916 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:37.112948 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:37.113505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:37.119783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:37.119783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:37.120006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:37.120006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:37.125038 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:37.125492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:37.126788 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:37.127222 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:37.177181 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:37.184658 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f60517b2-d527-44bb-8555-985f64d0a4b4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1245 microversion: 2.1 time: 0.082228 May 11 21:08:37.185226 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 262/541] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:37 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:37.261481 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:37.269648 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-337a79c9-b278-43be-ab23-70d87bc95773 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1453 microversion: 2.1 time: 0.155460 May 11 21:08:37.270579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 280/542] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:37 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:37.967291 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:37.967852 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:37.975649 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:37.976120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:37.978014 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:37.978014 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:38.112160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:38.119509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-efafb812-2a5c-493f-a647-1547b4f51db5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.156069 May 11 21:08:38.120077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 263/543] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:37 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:38.201906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:38.202702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:38.208436 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:38.208880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:38.209670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:38.210105 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:38.302156 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:38.309903 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d5365708-abe3-4315-bafe-a228be00afa6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1301 microversion: 2.1 time: 0.111759 May 11 21:08:38.310475 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 281/544] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:38 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:39.136740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:39.137497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:39.143945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:39.144403 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:39.145170 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:39.145641 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:39.271548 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:39.279334 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fecc2430-fa8e-4c73-9869-d5dabfc6b307 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.146519 May 11 21:08:39.280020 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 264/545] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:39 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:39.327196 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:39.327830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:39.333746 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:39.334195 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:39.334963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:39.335396 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:39.638709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:39.647127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b37623c4-c03a-49e4-8978-b94396324dee tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.323797 May 11 21:08:39.647957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 282/546] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:39 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:40.296405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:40.297063 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:40.303624 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:40.304066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:40.304868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:40.305314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:40.435594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:40.443482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-73f7f9c8-24d2-4cda-a512-df3071c7dddf tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.150918 May 11 21:08:40.444050 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 265/547] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:40 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:40.603218 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-cd14b055-334a-43c3-95a2-003fa4b4d8a5 req-7890bde2-5b08-4423-8873-54f8830d14c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3855665-64e1-4b51-9e7b-a46354bde903", "tag": "e2cb6f2a-c41b-40ff-8244-7d1958f2b07e"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:40.611601 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-cd14b055-334a-43c3-95a2-003fa4b4d8a5 req-7890bde2-5b08-4423-8873-54f8830d14c6 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:40.612050 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-cd14b055-334a-43c3-95a2-003fa4b4d8a5 req-7890bde2-5b08-4423-8873-54f8830d14c6 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:40.622948 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-cd14b055-334a-43c3-95a2-003fa4b4d8a5 req-7890bde2-5b08-4423-8873-54f8830d14c6 service nova] Creating event network-changed:e2cb6f2a-c41b-40ff-8244-7d1958f2b07e for instance b3855665-64e1-4b51-9e7b-a46354bde903 on hv-cinder-84146 May 11 21:08:40.628610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-cd14b055-334a-43c3-95a2-003fa4b4d8a5 req-7890bde2-5b08-4423-8873-54f8830d14c6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029082 May 11 21:08:40.629201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 283/548] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:40.664187 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:40.664790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:40.670933 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:40.671426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:40.672317 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:40.673455 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:40.843086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:40.853960 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-27eca020-acca-4afd-aec6-44e32ed79fd0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.193452 May 11 21:08:40.855127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 266/549] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:40 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:41.464633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:41.465381 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:41.488762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:41.489474 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:41.493310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:41.493310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:41.737582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:41.745254 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8928a455-b622-4c65-93a8-db36e1d82531 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.288268 May 11 21:08:41.745855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 284/550] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:41 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:41.871837 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:41.872452 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:41.879357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:41.879809 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:41.880587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:41.882342 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:42.009895 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:42.017707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ca2000fb-13b1-4af3-a9dc-ab688dc2f3f1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.149370 May 11 21:08:42.018263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 267/551] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:41 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:42.642762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-fbe32b39-a60a-4ea7-8745-7ce7718daf47 req-6acbc0c0-dbb5-46a9-9006-a3b464105445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c477417-2e64-4722-ba8d-e9765385ff3f", "tag": "6768c9cf-6579-4217-a3ff-b3ad7fd9951b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:42.650912 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fbe32b39-a60a-4ea7-8745-7ce7718daf47 req-6acbc0c0-dbb5-46a9-9006-a3b464105445 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:42.651350 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fbe32b39-a60a-4ea7-8745-7ce7718daf47 req-6acbc0c0-dbb5-46a9-9006-a3b464105445 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:42.662047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-fbe32b39-a60a-4ea7-8745-7ce7718daf47 req-6acbc0c0-dbb5-46a9-9006-a3b464105445 service nova] Creating event network-changed:6768c9cf-6579-4217-a3ff-b3ad7fd9951b for instance 1c477417-2e64-4722-ba8d-e9765385ff3f on hv-cinder-84146 May 11 21:08:42.666809 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-fbe32b39-a60a-4ea7-8745-7ce7718daf47 req-6acbc0c0-dbb5-46a9-9006-a3b464105445 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027605 May 11 21:08:42.667375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 285/552] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:42.766020 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:42.766560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:42.773140 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:42.777642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:42.777642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:42.777642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:42.902863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:42.910936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ba7accbd-be24-4543-adc8-dc19c3a7d086 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.148745 May 11 21:08:42.911596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 268/553] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:42 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:43.035982 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:43.036728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:43.043131 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:43.043581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:43.044358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:43.045188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:43.238470 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:43.245741 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3cc8b1f3-ed8c-4317-99aa-6b48e2bacb63 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.214573 May 11 21:08:43.246296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 286/554] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:43 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:43.928673 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:43.929288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:43.935710 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:43.936175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:43.936958 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:43.937397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:44.071597 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:44.078862 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e10d47a0-7cea-43ae-86bb-407c710a6df0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.154129 May 11 21:08:44.079428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 269/555] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:43 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:44.262838 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:44.263446 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:44.269237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:44.269724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:44.270483 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:44.270911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:44.399676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:44.406990 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9f09e6a2-b2a6-4d45-9fb6-6b25259c1f9b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.147949 May 11 21:08:44.411492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 287/556] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:44 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:45.030238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1992414983", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:45.078308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] validate_networks() for None {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:08:45.100464 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:45.101060 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:45.108984 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:45.108984 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:45.108984 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:45.108984 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:45.239812 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:45.247140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-87e60725-d811-47f4-953c-afb27e4dbad5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.150527 May 11 21:08:45.247702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 288/557] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:45 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:45.344308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:08:45.344726 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:08:45.345865 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:08:45.346275 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:08:45.346679 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:08:45.355116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:45.361068 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:45.361068 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:45.361068 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:45.372908 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Getting quotas for project 5a2c60193ec94c6ea7d7247efe9fc087. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:08:45.377042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Getting quotas for user 042459bc6511428aad3faedd436ee565 and project 5a2c60193ec94c6ea7d7247efe9fc087. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:08:45.387453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:08:45.389515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:08:45.423287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:45.423894 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:45.429660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:45.430146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:45.430899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:45.431328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:45.509164 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-561d0004-018a-4a7b-865b-e5ee8358c76d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482743 May 11 21:08:45.509852 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 270/558] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:08:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:08:45.523141 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fba51a79-ac56-4c98-bb5c-b7eb95debcfc tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:45.523754 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fba51a79-ac56-4c98-bb5c-b7eb95debcfc tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:45.563614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:45.571737 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ccf4ba9c-cba1-4b18-8b81-abeb1cd11157 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.152249 May 11 21:08:45.572309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 289/559] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:45 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:45.575457 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fba51a79-ac56-4c98-bb5c-b7eb95debcfc tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:45.583184 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fba51a79-ac56-4c98-bb5c-b7eb95debcfc tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1215 microversion: 2.1 time: 0.066270 May 11 21:08:45.583746 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 271/560] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:45 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:46.264372 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:46.264980 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:46.271760 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:46.271760 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:46.272040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:46.272639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:46.404199 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:46.411777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c3158dc1-50ae-438b-8f10-e0ac3b68a8c4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.151484 May 11 21:08:46.412437 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 290/561] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:46 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:46.473129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-88ccd1c1-fd12-48ef-a7e8-6485f03712d9 req-432b763f-5188-4b96-a818-128dfb988f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c477417-2e64-4722-ba8d-e9765385ff3f", "name": "network-vif-plugged", "status": "completed", "tag": "6768c9cf-6579-4217-a3ff-b3ad7fd9951b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:46.481386 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-88ccd1c1-fd12-48ef-a7e8-6485f03712d9 req-432b763f-5188-4b96-a818-128dfb988f44 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:46.481877 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-88ccd1c1-fd12-48ef-a7e8-6485f03712d9 req-432b763f-5188-4b96-a818-128dfb988f44 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:46.492737 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-88ccd1c1-fd12-48ef-a7e8-6485f03712d9 req-432b763f-5188-4b96-a818-128dfb988f44 service nova] Creating event network-vif-plugged:6768c9cf-6579-4217-a3ff-b3ad7fd9951b for instance 1c477417-2e64-4722-ba8d-e9765385ff3f on hv-cinder-84146 May 11 21:08:46.497804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-88ccd1c1-fd12-48ef-a7e8-6485f03712d9 req-432b763f-5188-4b96-a818-128dfb988f44 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028366 May 11 21:08:46.498382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 272/562] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:46.588273 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:46.589075 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:46.595159 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:46.595621 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:46.601440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:46.601440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:46.602459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:46.602459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:46.610077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:46.611031 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:46.612048 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:46.612279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:46.675916 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:46.692020 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-882d7d7a-0d90-4fc0-8bbe-142760b44af3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1219 microversion: 2.1 time: 0.095091 May 11 21:08:46.693378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 273/563] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:46 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:46.746515 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:46.754412 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dc7c5926-277e-4d87-ba50-e03825fb14eb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.170085 May 11 21:08:46.754968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 291/564] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:46 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:47.428135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:47.428733 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:47.434544 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:47.434991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:47.435740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:47.436167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:47.563970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:47.571382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c0df2f9b-bb01-4d93-882e-b9bca27ae180 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.147072 May 11 21:08:47.571952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 274/565] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:47 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:47.709397 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:47.710038 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:47.715888 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:47.716335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:47.717085 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:47.717511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:47.771089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:47.771728 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:47.778087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:47.779060 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:47.779307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:47.779743 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:47.781076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:47.788889 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f799c541-206d-420e-8b23-0a98b442edf5 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1267 microversion: 2.1 time: 0.083257 May 11 21:08:47.789424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 292/566] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:47 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:47.906678 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:47.914418 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d0519666-4d08-4488-b00a-9a8150388723 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.147226 May 11 21:08:47.914968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 275/567] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:47 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:48.588831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:48.589437 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:48.595796 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:48.596240 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:48.596999 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:48.597434 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:48.719202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:48.726983 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3203bb0a-19af-4eee-9ff7-79a81fde538b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.141975 May 11 21:08:48.727519 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 293/568] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:48 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:48.806594 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:48.807271 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:48.813689 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:48.814143 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:48.814912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:48.815382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:48.875493 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:48.882746 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f93b22d0-57b8-4eff-8572-0fd6dcb93ba8 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1285 microversion: 2.1 time: 0.079950 May 11 21:08:48.883308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 276/569] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:48 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1285 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:48.932051 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:48.932588 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:48.938698 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:48.939439 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:48.940411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:48.940842 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:49.207363 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:49.214776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6e614577-948b-4061-a389-1c4d30061a1a tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1367 microversion: 2.1 time: 0.286656 May 11 21:08:49.215341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 294/570] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:48 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:49.744563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:49.745348 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:49.751234 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:49.752330 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:49.753133 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:49.753597 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:49.883247 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:49.891138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-90b8f1ff-98df-46b7-88de-4b8a2374d8b8 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1677 microversion: 2.1 time: 0.150423 May 11 21:08:49.891714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 277/571] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:49 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:49.900421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:49.901032 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:49.908217 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:49.908668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:49.909432 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:49.909967 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:49.979586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:49.987333 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b58a57bd-4f76-44e7-b952-b11a03e5a879 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1273 microversion: 2.1 time: 0.091228 May 11 21:08:49.987897 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 295/572] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:49 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:50.231552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:50.232158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:50.238678 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:50.239132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:50.239900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:50.240330 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:50.403651 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:50.412379 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b9cd6e41-d105-4916-82dd-4a6a6f31975d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1556 microversion: 2.1 time: 0.184709 May 11 21:08:50.412965 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 278/573] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:50 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1556 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:50.430905 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-274f7503-3bc2-4edd-9444-93721f2b29c9 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:50.433151 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-274f7503-3bc2-4edd-9444-93721f2b29c9 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:50.441593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-274f7503-3bc2-4edd-9444-93721f2b29c9 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:50.442095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-274f7503-3bc2-4edd-9444-93721f2b29c9 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:50.443053 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-274f7503-3bc2-4edd-9444-93721f2b29c9 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:50.443458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-274f7503-3bc2-4edd-9444-93721f2b29c9 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:50.552269 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-274f7503-3bc2-4edd-9444-93721f2b29c9 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126543 May 11 21:08:50.552893 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 296/574] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:08:50 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:50.909690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:50.910310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:50.916747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:50.917557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:50.918474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:50.918912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.008418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:51.009031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:51.014961 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.015466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.016334 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.017278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.148767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:51.156905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6488fc51-46f9-448a-ba38-823721f14df5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1654 microversion: 2.1 time: 0.252438 May 11 21:08:51.164249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 279/575] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:50 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1654 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:51.176167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a00ab9aa-5548-4960-ab0f-30e453f5d514 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:51.182693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a00ab9aa-5548-4960-ab0f-30e453f5d514 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.183242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a00ab9aa-5548-4960-ab0f-30e453f5d514 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.210922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a00ab9aa-5548-4960-ab0f-30e453f5d514 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Going to try to start instance {{(pid=117612) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 21:08:51.224449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:51.235051 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2fdfacb6-0422-4fe9-b2ea-5d3c9cae5e42 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.230656 May 11 21:08:51.238347 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 297/576] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:51 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:51.400867 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a00ab9aa-5548-4960-ab0f-30e453f5d514 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action" status: 202 len: 0 microversion: 2.1 time: 0.229323 May 11 21:08:51.401503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 280/577] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:08:51 2022] POST /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:08:51.411130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:51.412025 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:51.419007 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.419589 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.420573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.421181 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.453683 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-cc5d3901-9033-48a1-97d5-0c24e186042b req-a6a341df-8244-467a-9462-5d4f9a3bb172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5941b8c0-91b8-4a55-a89a-ce08c7d18b8b", "tag": "871cc2ad-3380-4d7d-91d5-65250a1251cf"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:51.465614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cc5d3901-9033-48a1-97d5-0c24e186042b req-a6a341df-8244-467a-9462-5d4f9a3bb172 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.468659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-cc5d3901-9033-48a1-97d5-0c24e186042b req-a6a341df-8244-467a-9462-5d4f9a3bb172 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.482525 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-cc5d3901-9033-48a1-97d5-0c24e186042b req-a6a341df-8244-467a-9462-5d4f9a3bb172 service nova] Creating event network-changed:871cc2ad-3380-4d7d-91d5-65250a1251cf for instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b on hv-cinder-84146 May 11 21:08:51.487980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-cc5d3901-9033-48a1-97d5-0c24e186042b req-a6a341df-8244-467a-9462-5d4f9a3bb172 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038804 May 11 21:08:51.488797 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 281/578] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:51.641849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:51.651636 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6db31d68-0342-4981-ad7f-5009c65b1ee1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1663 microversion: 2.1 time: 0.245191 May 11 21:08:51.652622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 298/579] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:51 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1663 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:51.769405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6df83a50-fcf4-4bd4-8a65-4bd1d4d17cae tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:51.770360 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6df83a50-fcf4-4bd4-8a65-4bd1d4d17cae tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:51.777407 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df83a50-fcf4-4bd4-8a65-4bd1d4d17cae tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.778257 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df83a50-fcf4-4bd4-8a65-4bd1d4d17cae tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.779303 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df83a50-fcf4-4bd4-8a65-4bd1d4d17cae tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.779876 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df83a50-fcf4-4bd4-8a65-4bd1d4d17cae tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.814802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6df83a50-fcf4-4bd4-8a65-4bd1d4d17cae tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments/2142b38a-c323-47cb-89ce-8b9b1207942a" status: 200 len: 194 microversion: 2.20 time: 0.050323 May 11 21:08:51.815411 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 282/580] 10.222.0.35 () {60 vars in 1453 bytes} [Wed May 11 21:08:51 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments/2142b38a-c323-47cb-89ce-8b9b1207942a => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 21:08:51.893206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:51.893724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:51.899887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.900340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.901366 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.901949 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.965625 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-9d12a155-560e-4065-a162-03bc35db77ce req-8e06c318-8617-4785-9244-3ddb331ce3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c477417-2e64-4722-ba8d-e9765385ff3f", "tag": "6768c9cf-6579-4217-a3ff-b3ad7fd9951b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:51.975324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9d12a155-560e-4065-a162-03bc35db77ce req-8e06c318-8617-4785-9244-3ddb331ce3cd service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:51.976268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9d12a155-560e-4065-a162-03bc35db77ce req-8e06c318-8617-4785-9244-3ddb331ce3cd service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:51.989221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-9d12a155-560e-4065-a162-03bc35db77ce req-8e06c318-8617-4785-9244-3ddb331ce3cd service nova] Creating event network-changed:6768c9cf-6579-4217-a3ff-b3ad7fd9951b for instance 1c477417-2e64-4722-ba8d-e9765385ff3f on hv-cinder-84146 May 11 21:08:51.994755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-9d12a155-560e-4065-a162-03bc35db77ce req-8e06c318-8617-4785-9244-3ddb331ce3cd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 May 11 21:08:51.995980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 283/581] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:52.005111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lazy-loading 'services' on Instance uuid b1e6f4c2-0bcd-4a54-854f-638f98f48a25 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:08:52.213730 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cfd67428-4e2b-4015-ba3f-0512656eb942 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments/2142b38a-c323-47cb-89ce-8b9b1207942a" status: 202 len: 0 microversion: 2.20 time: 0.324749 May 11 21:08:52.214622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 299/582] 10.222.0.35 () {60 vars in 1456 bytes} [Wed May 11 21:08:51 2022] DELETE /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments/2142b38a-c323-47cb-89ce-8b9b1207942a => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 21:08:52.231861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4bad249f-7932-416a-9db3-0a2a609a1c4d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:52.233050 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4bad249f-7932-416a-9db3-0a2a609a1c4d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:52.242124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bad249f-7932-416a-9db3-0a2a609a1c4d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:52.243232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bad249f-7932-416a-9db3-0a2a609a1c4d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:52.244365 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bad249f-7932-416a-9db3-0a2a609a1c4d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:52.244894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bad249f-7932-416a-9db3-0a2a609a1c4d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:52.254811 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:52.256244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:52.271419 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:52.272828 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:52.273743 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:52.274279 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:52.318188 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4bad249f-7932-416a-9db3-0a2a609a1c4d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098928 May 11 21:08:52.319435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 284/583] 10.222.0.35 () {60 vars in 1342 bytes} [Wed May 11 21:08:52 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 21:08:52.520816 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:52.528513 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5bc91814-6b9e-4031-a54a-98b2e5cecc1b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.277910 May 11 21:08:52.529075 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 300/584] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:52 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:52.669897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:52.670555 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:52.676290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:52.676736 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:52.677499 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:52.677958 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:52.827979 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:52.836524 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-564d2b6f-0b6c-4b4b-96c6-516e48380bf6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1663 microversion: 2.1 time: 0.170501 May 11 21:08:52.837196 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 285/585] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:52 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:53.330853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cab4f13a-a510-4e83-ac0b-cd938cc64e17 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:53.331837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cab4f13a-a510-4e83-ac0b-cd938cc64e17 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:53.337761 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cab4f13a-a510-4e83-ac0b-cd938cc64e17 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:53.338207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cab4f13a-a510-4e83-ac0b-cd938cc64e17 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:53.338963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cab4f13a-a510-4e83-ac0b-cd938cc64e17 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:53.339399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cab4f13a-a510-4e83-ac0b-cd938cc64e17 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:53.368005 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cab4f13a-a510-4e83-ac0b-cd938cc64e17 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041181 May 11 21:08:53.373786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 301/586] 10.222.0.35 () {60 vars in 1342 bytes} [Wed May 11 21:08:53 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 21:08:53.546052 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:53.546656 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:53.553493 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:53.553967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:53.554719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:53.555225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:53.682301 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:53.689607 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-86d47974-a669-4bc8-a0b7-9ab1a3dffdb3 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.147406 May 11 21:08:53.690170 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 286/587] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:53 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:53.859265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:53.859265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:53.861779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:53.862208 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:53.862954 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:53.863427 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.002380 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:54.009619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-57ebb2f7-bd09-44dd-87b2-ff0f624a254a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1663 microversion: 2.1 time: 0.159528 May 11 21:08:54.010180 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 302/588] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:53 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:54.380496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d6c804e7-4eb0-4410-8b79-21f5ebf573a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:54.381604 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d6c804e7-4eb0-4410-8b79-21f5ebf573a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:54.387871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6c804e7-4eb0-4410-8b79-21f5ebf573a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.388327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6c804e7-4eb0-4410-8b79-21f5ebf573a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.389102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6c804e7-4eb0-4410-8b79-21f5ebf573a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.389553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d6c804e7-4eb0-4410-8b79-21f5ebf573a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.418468 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d6c804e7-4eb0-4410-8b79-21f5ebf573a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042560 May 11 21:08:54.419028 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 287/589] 10.222.0.35 () {60 vars in 1342 bytes} [Wed May 11 21:08:54 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:54.475413 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:54.475920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:54.481647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.482095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.482852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.483283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.507515 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:08:54.705424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:54.706141 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:54.712488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.712933 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.713718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.714150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.820143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cac05ffc-7d63-4796-89d3-807824d6e163 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 204 len: 0 microversion: 2.20 time: 0.348205 May 11 21:08:54.821050 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 303/590] 10.222.0.35 () {60 vars in 1279 bytes} [Wed May 11 21:08:54 2022] DELETE /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 21:08:54.830434 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:54.831192 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:54.836878 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.837324 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.838118 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:54.838548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:54.843527 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:54.851483 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-21f37421-4397-4ce2-86ea-2bd64a66aa05 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.149816 May 11 21:08:54.852039 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 288/591] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:54 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:08:54.967794 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:54.975408 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:54.976901 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:54.978069 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-334fb5f7-4b46-45bd-9ebe-4e4fe855bd9f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.152731 May 11 21:08:54.978619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 304/592] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:08:54 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:08:55.026622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:55.027219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:55.033059 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:55.033499 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:55.034289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:55.034745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:55.164002 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:55.171285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-42750419-015c-45d4-8b80-fc22b1a7a38a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1663 microversion: 2.1 time: 0.148786 May 11 21:08:55.171879 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 289/593] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:55 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:55.868085 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:55.868725 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:55.874733 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:55.875182 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:55.875949 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:55.877048 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:55.996117 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:55.996778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:56.003047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:56.003503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:56.004275 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:56.004600 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:56.004727 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:56.012057 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a5bb47d1-e83f-40ef-b29d-011f3feb03a6 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.147785 May 11 21:08:56.012711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 305/594] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:55 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:56.127808 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:56.135579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:56.137076 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:56.138328 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bf60e3a2-2905-48c7-a2c7-9ac01b8fadaa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.146070 May 11 21:08:56.138882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 290/595] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:08:55 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:08:56.187996 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:56.188633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:56.194488 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:56.194941 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:56.195712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:56.196153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:56.326545 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:56.328938 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5ac7c303-cc54-499a-95b6-4daa26306c61 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1667 microversion: 2.1 time: 0.144699 May 11 21:08:56.330099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 306/596] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:56 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1667 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:57.028560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:57.029219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:57.035811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:57.036271 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:57.037024 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:57.037484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:57.161492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:57.162246 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:57.172784 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:57.177749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:57.177749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:57.177749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:57.184895 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:57.193386 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5ec7ef91-b25b-4a06-acc1-2b710b89003b tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.168625 May 11 21:08:57.194287 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 291/597] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:57 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:57.406318 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:57.414611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:57.416107 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:57.417244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6556e09e-ebaf-43dd-9cae-54121ca7fc08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1723 microversion: 2.20 time: 0.263982 May 11 21:08:57.417828 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 307/598] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:08:57 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:08:58.210416 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:58.211036 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:58.218349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:58.218803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:58.219574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:58.220058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:58.241845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-01e89017-bec4-4887-a110-8b672313f6c0 req-3d57095b-359a-454c-84a3-77d168d3312a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e6f4c2-0bcd-4a54-854f-638f98f48a25", "name": "network-vif-deleted", "tag": "17516495-e3a1-4e3b-9f09-7e6a38573ceb"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:58.252059 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-01e89017-bec4-4887-a110-8b672313f6c0 req-3d57095b-359a-454c-84a3-77d168d3312a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:58.252584 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-01e89017-bec4-4887-a110-8b672313f6c0 req-3d57095b-359a-454c-84a3-77d168d3312a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:58.264919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-01e89017-bec4-4887-a110-8b672313f6c0 req-3d57095b-359a-454c-84a3-77d168d3312a service nova] Creating event network-vif-deleted:17516495-e3a1-4e3b-9f09-7e6a38573ceb for instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 on hv-cinder-84146 May 11 21:08:58.270689 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-01e89017-bec4-4887-a110-8b672313f6c0 req-3d57095b-359a-454c-84a3-77d168d3312a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 May 11 21:08:58.271880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 308/599] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:08:58.361617 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:58.366604 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f367a5ee-16b1-4696-aecd-fdbb6f28fd86 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.160244 May 11 21:08:58.367173 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 292/600] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:58 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:58.440266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:58.440266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:58.445707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:58.446286 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:58.447166 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:58.447751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:58.523162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:58.531529 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:58.533751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:58.534877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-38e2fca7-ffa6-4e18-a59c-3b9de14037a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 200 len: 1366 microversion: 2.20 time: 0.102429 May 11 21:08:58.538060 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 309/601] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:08:58 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:08:58.567232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-2d1a2f91-34dc-4c99-b9ff-09c320a4acf4 req-5e8f108b-d9cf-4a06-8a06-20fcf55f503a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5941b8c0-91b8-4a55-a89a-ce08c7d18b8b", "name": "network-vif-plugged", "status": "completed", "tag": "871cc2ad-3380-4d7d-91d5-65250a1251cf"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:08:58.577643 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-2d1a2f91-34dc-4c99-b9ff-09c320a4acf4 req-5e8f108b-d9cf-4a06-8a06-20fcf55f503a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:58.578092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-2d1a2f91-34dc-4c99-b9ff-09c320a4acf4 req-5e8f108b-d9cf-4a06-8a06-20fcf55f503a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:58.589647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-2d1a2f91-34dc-4c99-b9ff-09c320a4acf4 req-5e8f108b-d9cf-4a06-8a06-20fcf55f503a service nova] Creating event network-vif-plugged:871cc2ad-3380-4d7d-91d5-65250a1251cf for instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b on hv-cinder-84146 May 11 21:08:58.594812 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-2d1a2f91-34dc-4c99-b9ff-09c320a4acf4 req-5e8f108b-d9cf-4a06-8a06-20fcf55f503a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039143 May 11 21:08:58.595402 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 293/602] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:08:59.383673 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:59.384310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:59.390607 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:59.392118 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:59.392351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:59.392792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:59.519536 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:08:59.527213 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-23761230-96a8-4a99-8074-1fff616b4763 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.147431 May 11 21:08:59.527796 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 310/603] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:08:59 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:08:59.553115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:59.553836 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:08:59.559945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:59.560397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:59.561158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:08:59.561624 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:08:59.574277 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] HTTP exception thrown: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Request method failure captured: May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 HTTP/1.1 May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCUAEkSrshwpMIJati8jMU53pn_s2-5-blewRzQktTw4QDRn4ZJ6s4rls9w2fqvbwxHPjux3UhdUSmnCiTIR6c4GQy8epyWQDkh0PPRu8l5fp2_fGgx66Gxd4bcfxrN97yUyXyzhOcYYOkvKmeZ6cQo3Dy1pbDkfSPEoCkcocIeGaIE May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Openstack-Nova-Api-Version: 2.20 May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:08:59.575869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d7666a6299cc4c44ac7495ed00f137dd May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:08:59.577577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b1e6f4c2-0bcd-4a54-854f-638f98f48a25'} May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:08:59.578761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:08:59.580801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:08:59.582235 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Returning 404 to user: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:08:59.582235 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6df18c57-ac69-4dca-a17d-444dc65d4fcd tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 404 len: 111 microversion: 2.20 time: 0.028807 May 11 21:08:59.582235 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 294/604] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:08:59 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 21:08:59.586455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5ca71673-4828-4231-83b7-66784bb78dff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '.version_select at 0x7ff898e72790>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:08:59.668121 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5ca71673-4828-4231-83b7-66784bb78dff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722104961" status: 204 len: 0 microversion: 2.20 time: 0.085328 May 11 21:08:59.668584 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 311/605] 10.222.0.35 () {60 vars in 1261 bytes} [Wed May 11 21:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722104961 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 21:09:00.428726 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-14f85e78-f0e6-43b9-9d0c-9c0bc3751335 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'create', calling method: .version_select at 0x7ff89801a4c0>, body: {"keypair": {"name": "tempest-keypair-55649486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZbpH56eITXUsXVY+8iJpJJCxoSxZp5NhHSOO4zN8OwRcOqyBjT7+u0TQSDUXd7bY/gIK2l29bSbgqlokgL60eJtUTNJzWCESe/nah8WiYW+qa+OdA7VsUnyfWIxInnsA=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:00.442124 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-14f85e78-f0e6-43b9-9d0c-9c0bc3751335 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:09:00.445797 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-14f85e78-f0e6-43b9-9d0c-9c0bc3751335 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for user d7666a6299cc4c44ac7495ed00f137dd and project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:09:00.544598 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:00.545205 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:00.551512 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:00.551957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:00.552712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:00.553145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:00.566082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-14f85e78-f0e6-43b9-9d0c-9c0bc3751335 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.141254 May 11 21:09:00.568016 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 295/606] 10.222.0.35 () {62 vars in 1199 bytes} [Wed May 11 21:09:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 21:09:00.683497 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:00.691113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f4f3a7c1-cf66-466a-ace4-85c5efa3e2a9 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1315 microversion: 2.1 time: 0.150444 May 11 21:09:00.699889 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 312/607] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:00 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:09:01.708463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:01.709176 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:01.715759 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:01.716211 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:01.716983 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:01.717418 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:01.846540 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:01.854101 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-686a4e5c-4449-400e-9092-3ffe7627804d tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1464 microversion: 2.1 time: 0.150094 May 11 21:09:01.854651 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 296/608] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:01 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:01.899668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:01.900183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:01.905927 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:01.906368 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:01.907642 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:01.908278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:01.932355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:09:02.302957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8def9c4f-6656-40bb-9798-d201bab66a7c tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "DELETE /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 204 len: 0 microversion: 2.1 time: 0.407103 May 11 21:09:02.303573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 313/609] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:09:01 2022] DELETE /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:09:02.312130 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:02.312822 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:02.320355 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:02.320355 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:02.320355 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:02.321310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:02.457288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:02.464522 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-37ce9eab-14e9-4185-b480-a9a6d63c3d08 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1470 microversion: 2.1 time: 0.156664 May 11 21:09:02.465086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 297/610] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:02 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:03.052628 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1605531310", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cba3ba85-9c39-4c2e-a36c-66082d4dfb25"}], "security_groups": [{"name": "tempest-securitygroup--799556855"}], "key_name": "tempest-keypair-55649486", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:03.150688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] validate_networks() for [('cba3ba85-9c39-4c2e-a36c-66082d4dfb25', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:09:03.482393 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:03.483036 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:03.489395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:03.489892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:03.490659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:03.491091 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:03.551540 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:09:03.551956 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:09:03.552419 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:09:03.552832 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:09:03.553225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:09:03.561674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:03.562117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:03.562910 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:03.563337 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:03.579240 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:09:03.583088 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Getting quotas for user d7666a6299cc4c44ac7495ed00f137dd and project 54d75c229dc14e59b53a1ec63a0f00f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:09:03.593700 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:09:03.596588 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:09:03.616870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:03.624484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1e9272cb-d380-4a92-9db7-51ce3efa5ac1 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1470 microversion: 2.1 time: 0.146065 May 11 21:09:03.625052 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 298/611] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:03 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:09:03.730964 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-af24e3ef-3342-4691-a1eb-bbee05b14472 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.683662 May 11 21:09:03.731613 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 314/612] 10.222.0.35 () {62 vars in 1187 bytes} [Wed May 11 21:09:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 21:09:03.742188 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3fae1322-0d26-4685-9af4-928b3adec2c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:03.742818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3fae1322-0d26-4685-9af4-928b3adec2c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:03.794193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3fae1322-0d26-4685-9af4-928b3adec2c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:03.801117 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3fae1322-0d26-4685-9af4-928b3adec2c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:03.802639 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3fae1322-0d26-4685-9af4-928b3adec2c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:03.803781 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3fae1322-0d26-4685-9af4-928b3adec2c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1280 microversion: 2.20 time: 0.065440 May 11 21:09:03.813988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 299/613] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:03 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:04.509824 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-a1ba526a-30d4-4924-a531-873f0b4f1043 req-f0037f3f-abb6-4eac-ba82-120e7d49c7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5941b8c0-91b8-4a55-a89a-ce08c7d18b8b", "name": "network-vif-deleted", "tag": "871cc2ad-3380-4d7d-91d5-65250a1251cf"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:04.518766 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a1ba526a-30d4-4924-a531-873f0b4f1043 req-f0037f3f-abb6-4eac-ba82-120e7d49c7d8 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:04.519203 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a1ba526a-30d4-4924-a531-873f0b4f1043 req-f0037f3f-abb6-4eac-ba82-120e7d49c7d8 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:04.531144 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-a1ba526a-30d4-4924-a531-873f0b4f1043 req-f0037f3f-abb6-4eac-ba82-120e7d49c7d8 service nova] Creating event network-vif-deleted:871cc2ad-3380-4d7d-91d5-65250a1251cf for instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b on hv-cinder-84146 May 11 21:09:04.536263 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-a1ba526a-30d4-4924-a531-873f0b4f1043 req-f0037f3f-abb6-4eac-ba82-120e7d49c7d8 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030865 May 11 21:09:04.536886 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 315/614] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:04.641079 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:04.642002 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:04.649458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:04.649941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:04.650700 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:04.651154 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:04.714298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:04.721867 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-20ee6d1c-7e1e-4bbc-aadc-702578c28c23 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1300 microversion: 2.1 time: 0.084756 May 11 21:09:04.722625 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 300/615] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:04 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:04.822822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:04.823548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:04.829934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:04.830391 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:04.831185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:04.831625 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:04.893422 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:04.902178 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:04.903731 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:04.904906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-41aece24-a503-4c53-82a5-1b609f642475 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1284 microversion: 2.20 time: 0.086504 May 11 21:09:04.905716 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 316/616] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:04 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:05.738792 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:05.739391 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:05.745717 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:05.746165 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:05.746956 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:05.747392 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:05.778302 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:05.778748 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:05.779207 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lazy-loading 'fault' on Instance uuid 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:09:05.819842 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042459bc6511428aad3faedd436ee565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a2c60193ec94c6ea7d7247efe9fc087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:05.826498 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-23699258-c661-4f7b-94ae-c94cebc88f14 tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 200 len: 1305 microversion: 2.1 time: 0.091540 May 11 21:09:05.827075 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 301/617] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:05 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:05.923487 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:05.924190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:05.930243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:05.930692 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:05.932176 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:05.932176 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:06.011816 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:06.019688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:06.022491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:06.022491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d63d5cbe-b1bd-4b67-a0bb-ec4af93fd4fc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1340 microversion: 2.20 time: 0.102766 May 11 21:09:06.023057 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 317/618] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:05 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:06.844221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:06.845596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] [instance: 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:06.852251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:06.852702 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:06.853475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:06.853934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:06.868021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] HTTP exception thrown: Instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b could not be found. May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Request method failure captured: May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b HTTP/1.1 May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCXb5U8delSrVTCaiMS-Pr4wGoXUVUMlZPxb3W7tV-SdhZaZ-VARsIoNBLU0RS8CFxto6DLP073Z3BbZADbI0p2CZY-0r4z-mL4cIAFV2r2FqezbFWcM8tjqylNYnoYEu9PUL4nLSiOOAh2XMkvNcRun_MObDfaJxIaJWbIPz2ROm2E May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 5a2c60193ec94c6ea7d7247efe9fc087 May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1434741415 May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:09:06.869899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/5a2c60193ec94c6ea7d7247efe9fc087"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_5a2c60193ec94c6ea7d7247efe9fc087"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a2c60193ec94c6ea7d7247efe9fc087"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/5a2c60193ec94c6ea7d7247efe9fc087"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1434741415 May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 5a2c60193ec94c6ea7d7247efe9fc087 May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1434741415 May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1434741415-project May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: 042459bc6511428aad3faedd436ee565 May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1434741415-project May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b could not be found. May 11 21:09:06.871225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '5941b8c0-91b8-4a55-a89a-ce08c7d18b8b'} May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b could not be found. May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:09:06.872515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b could not be found. May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b could not be found. May 11 21:09:06.874482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:06.876104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] Returning 404 to user: Instance 5941b8c0-91b8-4a55-a89a-ce08c7d18b8b could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:09:06.876104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7c6c60fc-7bc6-4c4f-9c63-91a2daddadee tempest-VolumesNegativeTest-1434741415 tempest-VolumesNegativeTest-1434741415-project] 10.222.0.35 "GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b" status: 404 len: 111 microversion: 2.1 time: 0.031233 May 11 21:09:06.876104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 302/619] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:06 2022] GET /compute/v2.1/servers/5941b8c0-91b8-4a55-a89a-ce08c7d18b8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:09:07.040418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:07.041163 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:07.047047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:07.050581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:07.050581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:07.050581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:07.248134 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:07.256470 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:07.257978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:07.259152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-34cd266c-3e3f-4404-9de5-5a871c517d10 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1405 microversion: 2.20 time: 0.222615 May 11 21:09:07.259701 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 318/620] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:07 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:09:07.672516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-53163db4-b886-4c27-b33b-d39e8309488c req-c763d9d8-00dd-4298-9744-cfeeacd25c02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f00c24-95f0-4551-990e-c18813091765", "tag": "f03f2724-557a-44bf-a2f6-34c8f1d25081"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:07.689249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-53163db4-b886-4c27-b33b-d39e8309488c req-c763d9d8-00dd-4298-9744-cfeeacd25c02 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:07.692332 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-53163db4-b886-4c27-b33b-d39e8309488c req-c763d9d8-00dd-4298-9744-cfeeacd25c02 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:07.707530 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-53163db4-b886-4c27-b33b-d39e8309488c req-c763d9d8-00dd-4298-9744-cfeeacd25c02 service nova] Creating event network-changed:f03f2724-557a-44bf-a2f6-34c8f1d25081 for instance b2f00c24-95f0-4551-990e-c18813091765 on hv-cinder-84146 May 11 21:09:07.713092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-53163db4-b886-4c27-b33b-d39e8309488c req-c763d9d8-00dd-4298-9744-cfeeacd25c02 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046173 May 11 21:09:07.713727 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 303/621] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:09:08.278114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:08.278712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:08.285628 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:08.286074 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:08.286837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:08.287263 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:08.467483 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:08.475804 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:08.477304 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:08.478414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-760346aa-53bd-4531-9370-d25938fecdad tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1405 microversion: 2.20 time: 0.204263 May 11 21:09:08.478963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 319/622] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:08 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:09.497456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:09.498183 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:09.504557 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:09.505047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:09.505841 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:09.506278 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:09.647390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:09.655213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:09.656687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:09.658292 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-92dd3172-5dab-4113-8dc7-57fc6a6347dc tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1405 microversion: 2.20 time: 0.165993 May 11 21:09:09.658847 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 304/623] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:09 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:10.676729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:10.677338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:10.683235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:10.683707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:10.684458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:10.684877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:10.820885 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:10.829702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:10.831193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:10.832278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-be98d8d4-62a0-44c6-ab8e-deb1296eaac9 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1405 microversion: 2.20 time: 0.160068 May 11 21:09:10.832835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 320/624] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:10 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:11.850666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:11.851330 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:11.857659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:11.858129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:11.862352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:11.862352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:11.987974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:11.995721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:11.997153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:11.998296 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f83d5249-f016-4775-a605-4c6a316bb846 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1405 microversion: 2.20 time: 0.151502 May 11 21:09:11.998859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 305/625] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:11 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:12.624765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-ae5988b8-fe85-4522-90c4-b35c75e7c69d req-24d8e53a-1ae9-4a90-9e06-63fd14966c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f00c24-95f0-4551-990e-c18813091765", "name": "network-vif-plugged", "status": "completed", "tag": "f03f2724-557a-44bf-a2f6-34c8f1d25081"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:12.632688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-ae5988b8-fe85-4522-90c4-b35c75e7c69d req-24d8e53a-1ae9-4a90-9e06-63fd14966c07 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:12.633107 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-ae5988b8-fe85-4522-90c4-b35c75e7c69d req-24d8e53a-1ae9-4a90-9e06-63fd14966c07 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:12.643817 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-ae5988b8-fe85-4522-90c4-b35c75e7c69d req-24d8e53a-1ae9-4a90-9e06-63fd14966c07 service nova] Creating event network-vif-plugged:f03f2724-557a-44bf-a2f6-34c8f1d25081 for instance b2f00c24-95f0-4551-990e-c18813091765 on hv-cinder-84146 May 11 21:09:12.649119 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-ae5988b8-fe85-4522-90c4-b35c75e7c69d req-24d8e53a-1ae9-4a90-9e06-63fd14966c07 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028042 May 11 21:09:12.649913 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 321/626] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:13.016817 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:13.017424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:13.024010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:13.024455 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:13.025214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:13.025675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:13.153169 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:13.163056 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:13.164621 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:13.165827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b5f86529-f8a6-46ff-b865-c27c9fffafff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1405 microversion: 2.20 time: 0.153498 May 11 21:09:13.166384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 306/627] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:13 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:13.737931 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7fede0e7-1484-4502-b185-b18a829d2f19 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8bbb4df-a3f1-41de-b802-1565a04a6384"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:13.738979 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7fede0e7-1484-4502-b185-b18a829d2f19 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:13.744966 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fede0e7-1484-4502-b185-b18a829d2f19 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:13.745403 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fede0e7-1484-4502-b185-b18a829d2f19 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:13.746198 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fede0e7-1484-4502-b185-b18a829d2f19 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:13.746626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7fede0e7-1484-4502-b185-b18a829d2f19 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:14.183802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:14.184405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:14.190759 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:14.191204 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:14.191960 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:14.192392 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:14.325083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:14.333398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:14.335039 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:14.336137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1ce3b4fe-ed15-4da8-968f-b4a0b80c1bff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1405 microversion: 2.20 time: 0.156208 May 11 21:09:14.336689 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 307/628] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:14 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:09:14.545990 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7fede0e7-1484-4502-b185-b18a829d2f19 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812864 May 11 21:09:14.546617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 322/629] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:09:13 2022] POST /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments => generated 194 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:15.355660 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:15.356257 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:15.363209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:15.363653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:15.364408 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:15.364850 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:15.491269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:15.498940 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:15.500434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:15.501598 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1c9234a7-a294-4ac8-965c-da622e901c25 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1598 microversion: 2.20 time: 0.149978 May 11 21:09:15.502227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 308/630] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:09:15 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:09:15.520058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-163144ba-0cd5-4c03-87da-fc271ba83f66 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:15.520721 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-163144ba-0cd5-4c03-87da-fc271ba83f66 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:15.527123 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-163144ba-0cd5-4c03-87da-fc271ba83f66 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:15.527575 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-163144ba-0cd5-4c03-87da-fc271ba83f66 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:15.528345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-163144ba-0cd5-4c03-87da-fc271ba83f66 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:15.528783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-163144ba-0cd5-4c03-87da-fc271ba83f66 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:15.606155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-163144ba-0cd5-4c03-87da-fc271ba83f66 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090803 May 11 21:09:15.606685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 323/631] 10.222.0.35 () {60 vars in 1315 bytes} [Wed May 11 21:09:15 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 21:09:16.893351 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-ed646555-5faf-4bab-bd9a-2d2ad07a3a5b req-767f0539-e1a6-452a-a6c8-bcf8f70bac60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f00c24-95f0-4551-990e-c18813091765", "tag": "f03f2724-557a-44bf-a2f6-34c8f1d25081"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:16.901848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ed646555-5faf-4bab-bd9a-2d2ad07a3a5b req-767f0539-e1a6-452a-a6c8-bcf8f70bac60 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:16.902297 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ed646555-5faf-4bab-bd9a-2d2ad07a3a5b req-767f0539-e1a6-452a-a6c8-bcf8f70bac60 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:16.915315 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-ed646555-5faf-4bab-bd9a-2d2ad07a3a5b req-767f0539-e1a6-452a-a6c8-bcf8f70bac60 service nova] Creating event network-changed:f03f2724-557a-44bf-a2f6-34c8f1d25081 for instance b2f00c24-95f0-4551-990e-c18813091765 on hv-cinder-84146 May 11 21:09:16.920116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-ed646555-5faf-4bab-bd9a-2d2ad07a3a5b req-767f0539-e1a6-452a-a6c8-bcf8f70bac60 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030327 May 11 21:09:16.920807 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 309/632] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:23.075209 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:23.076203 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:23.082346 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:23.082812 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:23.083581 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:23.084014 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:23.105992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lazy-loading 'flavor' on Instance uuid 6afa6104-9267-474c-aa59-3e38d5636e78 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:09:23.448897 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a0d1a966-0ad1-4256-97ce-21789b6d0071 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/action" status: 200 len: 32 microversion: 2.1 time: 0.378027 May 11 21:09:23.449476 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 324/633] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:09:23 2022] POST /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:09:23.459497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:23.460201 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:23.466759 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:23.467214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:23.467989 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:23.468430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:23.597064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:23.604914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bd499f06-c8d4-4224-b509-fbb671840be2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.149594 May 11 21:09:23.605483 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 310/634] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:23 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:24.623040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:24.623734 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:24.629823 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:24.630274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:24.631034 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:24.631468 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:24.760428 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:24.768557 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-32ea67dd-bb43-488d-8b9f-0e4aa9f020e3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.150152 May 11 21:09:24.769123 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 325/635] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:24 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:25.785151 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:25.785785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:25.792151 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:25.792597 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:25.793389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:25.793845 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:25.921497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:25.929994 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6412e0cc-3385-4e76-a7cb-4577d69fed0f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.148598 May 11 21:09:25.930566 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 311/636] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:25 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:26.947000 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:26.947606 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:26.954216 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:26.955197 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:26.955964 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:26.956397 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:27.081585 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:27.089491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8284280-130f-4489-8146-fc926ca3bd8d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.146362 May 11 21:09:27.090081 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 326/637] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:26 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:28.106631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:28.107173 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:28.113428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:28.113897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:28.114650 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:28.115081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:28.238939 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:28.246534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f8ab09f2-af81-4ba5-9453-05be79a4103d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.143819 May 11 21:09:28.247090 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 312/638] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:28 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:29.264496 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:29.265029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:29.272117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:29.272564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:29.273318 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:29.274037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:29.399972 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:29.407776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bf036eb6-7f10-45c9-8058-5e345b283878 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.147160 May 11 21:09:29.408340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 327/639] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:29 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:30.425906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:30.426507 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:30.432774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:30.433217 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:30.434007 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:30.434440 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:30.562354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:30.569979 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eb164412-f5bc-4753-a72c-4d5bd78acf37 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.148498 May 11 21:09:30.570539 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 313/640] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:30 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:31.586943 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:31.587545 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:31.593776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:31.594221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:31.594971 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:31.595400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:31.723347 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:31.731328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-589eab36-93fe-40c3-b503-91d532ffc34e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.148194 May 11 21:09:31.731890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 328/641] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:31 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:32.748753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:32.749274 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:32.756107 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:32.756554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:32.757311 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:32.757777 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:32.882394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:32.890092 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9426a8ec-69c5-4e87-9a80-fd70d7f365fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.145275 May 11 21:09:32.890664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 314/642] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:32 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:33.060669 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-de4b4178-dfd0-4236-a9f9-6d6868b802ed tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:33.061270 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-de4b4178-dfd0-4236-a9f9-6d6868b802ed tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:33.068102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de4b4178-dfd0-4236-a9f9-6d6868b802ed tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:33.068551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de4b4178-dfd0-4236-a9f9-6d6868b802ed tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:33.069298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de4b4178-dfd0-4236-a9f9-6d6868b802ed tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:33.069757 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de4b4178-dfd0-4236-a9f9-6d6868b802ed tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:33.091761 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-de4b4178-dfd0-4236-a9f9-6d6868b802ed tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035289 May 11 21:09:33.092311 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 329/643] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:09:33 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:33.907226 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:33.907833 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:33.914484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:33.914932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:33.915698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:33.916137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:34.044178 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:34.061430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-29982b7c-22ea-4a3b-b33a-be941b00bc46 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.148599 May 11 21:09:34.061430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 315/644] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:33 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:34.655457 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-53a474be-7b28-42c2-84e8-7a0802e2b470 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d65499d-ce91-40a3-8ea9-cacb862fb16e"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:34.656570 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-53a474be-7b28-42c2-84e8-7a0802e2b470 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:34.662772 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53a474be-7b28-42c2-84e8-7a0802e2b470 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:34.663161 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53a474be-7b28-42c2-84e8-7a0802e2b470 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:34.663911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53a474be-7b28-42c2-84e8-7a0802e2b470 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:34.664338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-53a474be-7b28-42c2-84e8-7a0802e2b470 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:35.068100 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:35.068733 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:35.075086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:35.075550 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:35.076301 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:35.076783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:35.201138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:35.209278 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-81238797-98a0-4792-97d7-a979f1a37466 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.145007 May 11 21:09:35.209877 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 316/645] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:35 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:09:35.351723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-53a474be-7b28-42c2-84e8-7a0802e2b470 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700020 May 11 21:09:35.352466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 330/646] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:09:34 2022] POST /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:36.226441 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:36.227040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:36.233235 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:36.233719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:36.234472 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:36.234902 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:36.359440 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:36.367701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-29c25804-ae05-43fc-ae81-5aabf16cd331 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.145030 May 11 21:09:36.368260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 317/647] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:36 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:37.385729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:37.386422 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:37.392539 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.393005 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:37.393829 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.394907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:37.479643 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-52d5c667-da96-459c-8813-7bfb89b9bb97 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:37.480632 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-52d5c667-da96-459c-8813-7bfb89b9bb97 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:37.487349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52d5c667-da96-459c-8813-7bfb89b9bb97 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.488507 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52d5c667-da96-459c-8813-7bfb89b9bb97 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:37.489347 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52d5c667-da96-459c-8813-7bfb89b9bb97 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.489895 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52d5c667-da96-459c-8813-7bfb89b9bb97 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:37.524103 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:37.529485 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-52d5c667-da96-459c-8813-7bfb89b9bb97 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053898 May 11 21:09:37.530086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 318/648] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:09:37 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 21:09:37.532257 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1a21cb9b-c003-4b46-9a19-e81203d1fe58 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.151276 May 11 21:09:37.532824 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 331/649] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:37 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:37.585570 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:37.586063 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:37.591829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.592273 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:37.593027 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.593456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:37.617818 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:09:37.899894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-600defb1-e980-457e-814b-f260d74282a2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 204 len: 0 microversion: 2.1 time: 0.318305 May 11 21:09:37.900487 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 319/650] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:09:37 2022] DELETE /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:09:37.914320 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:37.914930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:37.921198 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.921726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:37.922490 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:37.922955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:38.053165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:38.060440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b7ba7bdb-44e5-4c08-9f0b-3112e5742899 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1673 microversion: 2.1 time: 0.149948 May 11 21:09:38.061006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 332/651] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:37 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:38.549752 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:38.550453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:38.557198 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:38.557685 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:38.558450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:38.558887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:38.693132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:38.700797 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e2492873-3714-4e5c-86c7-104c8d67d276 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.155454 May 11 21:09:38.701356 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 320/652] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:38 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:39.078164 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:39.078769 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:39.085516 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:39.085992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:39.086755 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:39.087190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:39.210830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:39.218044 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f4039ea3-5831-477b-b91f-346f18cfdc60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1673 microversion: 2.1 time: 0.143746 May 11 21:09:39.218607 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 333/653] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:39 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:39.717756 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:39.718366 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:39.724808 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:39.725258 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:39.726040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:39.726474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:39.853384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:39.861343 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2e40ec8e-c7f4-40ea-a419-e637135f8528 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.147340 May 11 21:09:39.861939 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 321/654] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:39 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:40.235654 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:40.236192 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:40.242955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:40.243401 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:40.244151 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:40.244578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:40.369446 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:40.376709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8f44e363-548c-443e-8524-6070f74addc4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1673 microversion: 2.1 time: 0.144986 May 11 21:09:40.377271 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 334/655] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:40 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:40.879083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:40.880183 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:40.886785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:40.887241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:40.888036 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:40.888476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:41.022104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:41.031174 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0c587ce9-b07a-49bd-bd19-8b41a1baa8bb tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.156211 May 11 21:09:41.031760 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 322/656] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:40 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:41.394558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:41.394558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:41.401047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:41.401423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:41.402214 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:41.402728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:41.578227 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:41.585503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7116b06b-4a36-43ae-942a-bd546e3126cd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1673 microversion: 2.1 time: 0.195529 May 11 21:09:41.586086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 335/657] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:41 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:41.971359 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-a3394bf9-5f73-4501-90bb-5252dca51e09 req-d9507c78-c8bc-43cb-98ad-26562999ba05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925e3d97-64b1-4637-9850-0c37d5f2a870", "name": "network-vif-deleted", "tag": "5c51e32e-4186-43e2-9063-ee5936dea096"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:41.979568 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-a3394bf9-5f73-4501-90bb-5252dca51e09 req-d9507c78-c8bc-43cb-98ad-26562999ba05 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:41.980086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-a3394bf9-5f73-4501-90bb-5252dca51e09 req-d9507c78-c8bc-43cb-98ad-26562999ba05 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:41.991648 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-a3394bf9-5f73-4501-90bb-5252dca51e09 req-d9507c78-c8bc-43cb-98ad-26562999ba05 service nova] Creating event network-vif-deleted:5c51e32e-4186-43e2-9063-ee5936dea096 for instance 925e3d97-64b1-4637-9850-0c37d5f2a870 on hv-cinder-84146 May 11 21:09:41.996787 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-a3394bf9-5f73-4501-90bb-5252dca51e09 req-d9507c78-c8bc-43cb-98ad-26562999ba05 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029197 May 11 21:09:41.997395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 323/658] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:42.049705 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:42.050610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:42.057618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:42.058339 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:42.059120 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:42.059563 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:42.196855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:42.218844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c467c61d-ca6b-407f-8336-af04aaf351e8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1735 microversion: 2.1 time: 0.173059 May 11 21:09:42.219876 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 336/659] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:42 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:42.603665 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:42.604358 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:42.610256 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:42.610703 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:42.611480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:42.611899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:42.642063 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:42.642508 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:42.642950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lazy-loading 'fault' on Instance uuid 925e3d97-64b1-4637-9850-0c37d5f2a870 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:09:42.683725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:42.691220 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b1a0bb76-43a4-4f71-8d1d-e637bfa660b1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1327 microversion: 2.1 time: 0.091672 May 11 21:09:42.691790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 324/660] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:42 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:43.235518 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:43.236060 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:43.242330 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.242780 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.243724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.244169 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.374491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:43.382928 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-94f3fb9c-d50c-4b67-ae60-188ac2f5fa62 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1715 microversion: 2.1 time: 0.151377 May 11 21:09:43.383492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 337/661] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:43 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:43.482923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:43.483427 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:43.490212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.490608 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.491375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.491826 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.574544 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] HTTP exception thrown: Cannot 'detach_volume' instance 6afa6104-9267-474c-aa59-3e38d5636e78 while it is in vm_state rescued May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Request method failure captured: May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments/a8bbb4df-a3f1-41de-b802-1565a04a6384 HTTP/1.1 May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCU-pZ8tTrn9OY2Wc4uDkMAlSJqVCr0KLJNOPdapQhLJnNgi_BS7FnKDFSmdGsxSkqXTmNbCv3QEP91gQC6euwQlfmKwCri1evt8cU_1IjIFdX0DbxC6AzKqf9D-w1wqg2naT3dlzBmznTHUWI1p14O6BzSFn-_y1NdwMhiZ9fKOshk May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:09:43.576153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/838ec035db164e50bc335d2cf141d943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_838ec035db164e50bc335d2cf141d943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: df9d6a9b73e64e31b014b5809912bbe8 May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:09:43.580662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Cannot 'detach_volume' instance 6afa6104-9267-474c-aa59-3e38d5636e78 while it is in vm_state rescued May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'server_id': '6afa6104-9267-474c-aa59-3e38d5636e78', 'id': 'a8bbb4df-a3f1-41de-b802-1565a04a6384'} May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6afa6104-9267-474c-aa59-3e38d5636e78 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:09:43.581599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6afa6104-9267-474c-aa59-3e38d5636e78 while it is in vm_state rescued May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6afa6104-9267-474c-aa59-3e38d5636e78 while it is in vm_state rescued May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:43.583209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Returning 409 to user: Cannot 'detach_volume' instance 6afa6104-9267-474c-aa59-3e38d5636e78 while it is in vm_state rescued {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:09:43.584429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-10234674-e22d-4fcd-9b14-ca0db36710c4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments/a8bbb4df-a3f1-41de-b802-1565a04a6384" status: 409 len: 152 microversion: 2.1 time: 0.098663 May 11 21:09:43.584429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 325/662] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:09:43 2022] DELETE /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments/a8bbb4df-a3f1-41de-b802-1565a04a6384 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 21:09:43.586512 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1ad25a9f-5a19-4537-a982-e9f3db2ebbc4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:43.587047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1ad25a9f-5a19-4537-a982-e9f3db2ebbc4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:43.592846 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ad25a9f-5a19-4537-a982-e9f3db2ebbc4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.593297 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ad25a9f-5a19-4537-a982-e9f3db2ebbc4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.594123 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ad25a9f-5a19-4537-a982-e9f3db2ebbc4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.594523 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ad25a9f-5a19-4537-a982-e9f3db2ebbc4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.708407 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:43.709022 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:43.715225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.715688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.716479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.716910 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.748903 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.749394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.749881 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lazy-loading 'fault' on Instance uuid 925e3d97-64b1-4637-9850-0c37d5f2a870 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:09:43.790426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:43.797828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b4b3a193-e776-4a7d-81e0-61a7385de9a4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 200 len: 1327 microversion: 2.1 time: 0.093473 May 11 21:09:43.798441 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 326/663] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:43 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:09:43.814087 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1ad25a9f-5a19-4537-a982-e9f3db2ebbc4 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "POST /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/action" status: 202 len: 0 microversion: 2.1 time: 0.231276 May 11 21:09:43.818792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 338/664] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:09:43 2022] POST /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:09:43.825036 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:43.825706 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:43.832005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.832453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.833221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.833687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.914844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d65499d-ce91-40a3-8ea9-cacb862fb16e"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:43.920264 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:43.922635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.923082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.923853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:43.924284 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:43.982579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:43.992078 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1faeac8c-1012-4632-b9f7-7bd1ebd389c2 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1723 microversion: 2.1 time: 0.171253 May 11 21:09:44.002886 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 327/665] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:43 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:44.022586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Invalid volume: volume 7d65499d-ce91-40a3-8ea9-cacb862fb16e is already attached to instances: 1c477417-2e64-4722-ba8d-e9765385ff3f May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: POST /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments HTTP/1.1 May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 74 May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:09:44.025229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {"volumeAttachment": {"volumeId": "7d65499d-ce91-40a3-8ea9-cacb862fb16e"}} May 11 21:09:44.026839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Invalid volume: volume 7d65499d-ce91-40a3-8ea9-cacb862fb16e is already attached to instances: 1c477417-2e64-4722-ba8d-e9765385ff3f May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'server_id': '1c477417-2e64-4722-ba8d-e9765385ff3f', 'body': {'volumeAttachment': {'volumeId': '7d65499d-ce91-40a3-8ea9-cacb862fb16e'}}} May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7d65499d-ce91-40a3-8ea9-cacb862fb16e is already attached to instances: 1c477417-2e64-4722-ba8d-e9765385ff3f May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:44.027919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7d65499d-ce91-40a3-8ea9-cacb862fb16e is already attached to instances: 1c477417-2e64-4722-ba8d-e9765385ff3f May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:44.029326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7d65499d-ce91-40a3-8ea9-cacb862fb16e is already attached to instances: 1c477417-2e64-4722-ba8d-e9765385ff3f May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 400 to user: Invalid volume: volume 7d65499d-ce91-40a3-8ea9-cacb862fb16e is already attached to instances: 1c477417-2e64-4722-ba8d-e9765385ff3f {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1b2f45e7-9e69-4b95-99cc-dd299bb9c322 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116805 May 11 21:09:44.030968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 339/666] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:09:43 2022] POST /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 21:09:44.088085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:44.088577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:44.094639 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:44.095087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:44.095852 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:44.096287 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:44.174657 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lazy-loading 'services' on Instance uuid 1c477417-2e64-4722-ba8d-e9765385ff3f {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:09:44.387928 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-60728ed1-1bf4-4eea-9b79-b08b1bf7bfab tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments/7d65499d-ce91-40a3-8ea9-cacb862fb16e" status: 202 len: 0 microversion: 2.1 time: 0.303579 May 11 21:09:44.388537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 328/667] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:09:44 2022] DELETE /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments/7d65499d-ce91-40a3-8ea9-cacb862fb16e => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 21:09:44.398066 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8e814bdb-ef0c-471f-9000-d74e2e44e245 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:44.399895 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8e814bdb-ef0c-471f-9000-d74e2e44e245 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:44.406709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e814bdb-ef0c-471f-9000-d74e2e44e245 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:44.407285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e814bdb-ef0c-471f-9000-d74e2e44e245 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:44.408410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e814bdb-ef0c-471f-9000-d74e2e44e245 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:44.408858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8e814bdb-ef0c-471f-9000-d74e2e44e245 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:44.438974 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8e814bdb-ef0c-471f-9000-d74e2e44e245 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045371 May 11 21:09:44.439538 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 340/668] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:09:44 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:44.816258 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:44.816860 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:44.823096 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:44.823539 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:44.824296 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:44.824722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:44.837363 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] HTTP exception thrown: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Request method failure captured: May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 HTTP/1.1 May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT4gBeOwXwRv25_24TWrP10tt7MS4_EyKFpWEuAogO0rV6ASvHNXAd_l_VqMn9bll-uwO7qAHpNZlA-CVBR1K-G92TJrvAK2KoxLWaEGWZz-FtQPwHkpP4H-XE4yVUoNXqhqMe8_BJ2TuU-SbEWBuYpay4iCTjwlI4tel-RC8a0Uds May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:09:44.838968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-791683183 May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-791683183-project May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: f9968edcee104432ade2014e39683bb5 May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-791683183-project May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:09:44.840333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '925e3d97-64b1-4637-9850-0c37d5f2a870'} May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:09:44.841111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:09:44.842941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:09:44.845089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Returning 404 to user: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:09:44.845089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2a8c89e9-60d6-40d2-ad2b-9959d0be94c6 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 404 len: 111 microversion: 2.1 time: 0.028850 May 11 21:09:44.845089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 329/669] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:44 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:09:44.850298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-08b453a9-50ac-4d62-8f8a-cf7cf46f248f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '.version_select at 0x7ff898060940>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:44.946076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-08b453a9-50ac-4d62-8f8a-cf7cf46f248f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631019521" status: 202 len: 0 microversion: 2.1 time: 0.100129 May 11 21:09:44.946672 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 341/670] 10.222.0.35 () {58 vars in 1217 bytes} [Wed May 11 21:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631019521 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:09:45.009626 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:45.010456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:45.016267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:45.016719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:45.017519 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:45.017978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:45.151811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:45.159552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b5f0fbc2-36b5-468f-9908-f66a06dfed78 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1723 microversion: 2.1 time: 0.153988 May 11 21:09:45.160104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 330/671] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:45 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:45.451909 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-46996506-f361-4c28-8e97-b0bb5ef85f3f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:45.453062 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-46996506-f361-4c28-8e97-b0bb5ef85f3f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:45.460782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-46996506-f361-4c28-8e97-b0bb5ef85f3f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:45.461310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-46996506-f361-4c28-8e97-b0bb5ef85f3f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:45.462134 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-46996506-f361-4c28-8e97-b0bb5ef85f3f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:45.462574 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-46996506-f361-4c28-8e97-b0bb5ef85f3f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:45.491901 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-46996506-f361-4c28-8e97-b0bb5ef85f3f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 May 11 21:09:45.495854 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 342/672] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:09:45 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:45.705887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1b141162-88bb-4a9d-8c25-535a6b2d588e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'create', calling method: .version_select at 0x7ff89808c670>, body: {"keypair": {"name": "tempest-keypair-1557565487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPDDfomdvuaV6OdhrVC8lMBt7RVesBQdlfMwJi1yMGY7ChXYE1OoSauY0EDfVjTjhRKOuhcVh/CbA7zVwZ2bk/5ZLTeIXodpAu4+ZwJ7MI8uBso/S66z7rrbcWZFD2WLw=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:45.719571 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-1b141162-88bb-4a9d-8c25-535a6b2d588e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:09:45.723261 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-1b141162-88bb-4a9d-8c25-535a6b2d588e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for user f9968edcee104432ade2014e39683bb5 and project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:09:45.824250 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1b141162-88bb-4a9d-8c25-535a6b2d588e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122277 May 11 21:09:45.824887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 331/673] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:09:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:46.177349 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:46.178061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:46.184186 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:46.184632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:46.185385 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:46.185843 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:46.487873 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:46.495577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1efb6346-9342-42f1-8c91-dd2c020656fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1723 microversion: 2.1 time: 0.322826 May 11 21:09:46.496135 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 343/674] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:46 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:46.503284 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e46811cc-691a-4cc5-ab5a-d3f7f361f376 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:46.504187 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e46811cc-691a-4cc5-ab5a-d3f7f361f376 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:46.509952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e46811cc-691a-4cc5-ab5a-d3f7f361f376 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:46.510389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e46811cc-691a-4cc5-ab5a-d3f7f361f376 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:46.511196 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e46811cc-691a-4cc5-ab5a-d3f7f361f376 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:46.511551 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e46811cc-691a-4cc5-ab5a-d3f7f361f376 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:46.541415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e46811cc-691a-4cc5-ab5a-d3f7f361f376 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 May 11 21:09:46.542000 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 332/675] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:09:46 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:47.512180 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:47.512782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:47.519004 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.519556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.520351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.520915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.553035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1c73b016-60e8-408f-a342-3da01d732971 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:47.554801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1c73b016-60e8-408f-a342-3da01d732971 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:47.561349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c73b016-60e8-408f-a342-3da01d732971 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.561820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c73b016-60e8-408f-a342-3da01d732971 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.562595 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c73b016-60e8-408f-a342-3da01d732971 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.563025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c73b016-60e8-408f-a342-3da01d732971 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.593770 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1c73b016-60e8-408f-a342-3da01d732971 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045350 May 11 21:09:47.595023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 333/676] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:09:47 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:09:47.654770 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:47.655268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:47.656517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:47.663784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.664467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.665237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7cdad48e-a214-417b-8ed0-31c004ad9f5f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1729 microversion: 2.1 time: 0.156909 May 11 21:09:47.665368 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.665703 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.666194 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 344/677] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:47 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:47.682451 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-90e0c341-04d6-4d34-8912-34a40731afbf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:47.682936 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-90e0c341-04d6-4d34-8912-34a40731afbf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:47.688617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90e0c341-04d6-4d34-8912-34a40731afbf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.689067 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90e0c341-04d6-4d34-8912-34a40731afbf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.689876 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90e0c341-04d6-4d34-8912-34a40731afbf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:47.690312 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-90e0c341-04d6-4d34-8912-34a40731afbf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:47.690625 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:09:47.765552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-90e0c341-04d6-4d34-8912-34a40731afbf tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086807 May 11 21:09:47.766302 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 345/678] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:09:47 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:09:47.984182 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1789280080", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26111c2a-0c3d-4253-b45f-aeacb402f250"}], "security_groups": [{"name": "tempest-securitygroup--1020479836"}], "key_name": "tempest-keypair-1557565487", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:48.020045 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0dd35dc9-2a25-4518-808d-ffeed1f46a8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 204 len: 0 microversion: 2.1 time: 0.368800 May 11 21:09:48.021147 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 334/679] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:09:47 2022] DELETE /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 21:09:48.030367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:48.031163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:48.040215 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:48.040674 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:48.041458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:48.041926 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:48.136610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] validate_networks() for [('26111c2a-0c3d-4253-b45f-aeacb402f250', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:09:48.227218 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:48.234565 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b313273a-6b5f-44c8-a901-956cc4bdb105 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1681 microversion: 2.1 time: 0.208788 May 11 21:09:48.235126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 335/680] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:48 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:09:49.001926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:09:49.002419 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:09:49.002789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:09:49.003187 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:09:49.003588 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:09:49.012416 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:49.012855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:49.013670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:49.014099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:49.031169 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:09:49.034947 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Getting quotas for user f9968edcee104432ade2014e39683bb5 and project 513637db58d34fe198b2de93d2cbbeaa. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:09:49.045665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:09:49.047912 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:09:49.169740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-af04a7e7-7651-49a4-87f6-8c9348bf3f7c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.189733 May 11 21:09:49.170563 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 346/681] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:09:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 21:09:49.180631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8c75428d-60b8-439d-bc03-b3a5b48c3ec3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:49.181240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8c75428d-60b8-439d-bc03-b3a5b48c3ec3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:49.234551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-6ad6bc4d-19d1-430c-81da-9c0e1c235559 req-715884c4-8346-429b-a049-e58f9a174d9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa6104-9267-474c-aa59-3e38d5636e78", "tag": "aa313336-1ef9-41c8-900a-4471c553fd70"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:49.244239 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6ad6bc4d-19d1-430c-81da-9c0e1c235559 req-715884c4-8346-429b-a049-e58f9a174d9c service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:49.244687 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-6ad6bc4d-19d1-430c-81da-9c0e1c235559 req-715884c4-8346-429b-a049-e58f9a174d9c service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:49.265218 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-6ad6bc4d-19d1-430c-81da-9c0e1c235559 req-715884c4-8346-429b-a049-e58f9a174d9c service nova] Creating event network-changed:aa313336-1ef9-41c8-900a-4471c553fd70 for instance 6afa6104-9267-474c-aa59-3e38d5636e78 on hv-cinder-84146 May 11 21:09:49.271378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-6ad6bc4d-19d1-430c-81da-9c0e1c235559 req-715884c4-8346-429b-a049-e58f9a174d9c service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040395 May 11 21:09:49.271589 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8c75428d-60b8-439d-bc03-b3a5b48c3ec3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:49.272111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 347/682] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:09:49.278016 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:49.278707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:49.279689 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8c75428d-60b8-439d-bc03-b3a5b48c3ec3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1238 microversion: 2.1 time: 0.102960 May 11 21:09:49.281386 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 336/683] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:49 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:49.294788 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:49.295313 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:49.296152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:49.296657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:49.469687 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:49.477256 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ff95f233-3028-40f7-bc7a-5aea04bc6cf4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1681 microversion: 2.1 time: 0.204129 May 11 21:09:49.477860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 348/684] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:49 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:50.296451 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:50.297205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:50.304978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:50.305418 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:50.306248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:50.306678 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:50.382050 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:50.389904 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-33fd15aa-8dfe-4cee-a76c-1a583557d00d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1242 microversion: 2.1 time: 0.097304 May 11 21:09:50.390482 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 337/685] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:50 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:50.494861 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:50.495594 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:50.502656 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:50.503173 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:50.504007 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:50.504599 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:50.850608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:50.858451 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-74cce54b-96e6-4439-9b06-2482ff0c0d3c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1681 microversion: 2.1 time: 0.367373 May 11 21:09:50.859011 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 349/686] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:50 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1681 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:51.289822 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-f564ed11-59ec-4694-be74-23f143d7edd2 req-6936b279-23a7-4343-8819-7d245555465f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa6104-9267-474c-aa59-3e38d5636e78", "tag": "aa313336-1ef9-41c8-900a-4471c553fd70"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:51.298279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-f564ed11-59ec-4694-be74-23f143d7edd2 req-6936b279-23a7-4343-8819-7d245555465f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:51.299061 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-f564ed11-59ec-4694-be74-23f143d7edd2 req-6936b279-23a7-4343-8819-7d245555465f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:51.310357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-f564ed11-59ec-4694-be74-23f143d7edd2 req-6936b279-23a7-4343-8819-7d245555465f service nova] Creating event network-changed:aa313336-1ef9-41c8-900a-4471c553fd70 for instance 6afa6104-9267-474c-aa59-3e38d5636e78 on hv-cinder-84146 May 11 21:09:51.315163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-f564ed11-59ec-4694-be74-23f143d7edd2 req-6936b279-23a7-4343-8819-7d245555465f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029217 May 11 21:09:51.315915 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 338/687] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:51.407514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:51.408168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:51.414395 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:51.414762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:51.415762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:51.416203 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:51.729781 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:51.737233 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-aad52fa4-ddb1-4363-9484-0656e4a335f4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1298 microversion: 2.1 time: 0.333788 May 11 21:09:51.737851 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 350/688] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:51 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1298 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:51.878089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:51.879364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:51.886502 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:51.886955 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:51.887724 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:51.888154 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:51.978933 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:51.986473 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e902f94c-e143-4435-ae3f-a7eaf1b494d3 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1613 microversion: 2.1 time: 0.113280 May 11 21:09:51.987150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 339/689] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:51 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1613 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:52.756041 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:52.756759 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:52.763614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:52.764309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:52.765084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:52.765519 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:52.950229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:52.955617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-65173e36-e335-4bf7-a5a7-3886fcd2f09d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1364 microversion: 2.1 time: 0.204519 May 11 21:09:52.956203 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 351/690] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:52 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:53.005649 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:53.006835 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:53.013485 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:53.013959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:53.014724 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:53.015258 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:53.060500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:53.060500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:53.060500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lazy-loading 'fault' on Instance uuid 1c477417-2e64-4722-ba8d-e9765385ff3f {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:09:53.110832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:53.119381 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1cc1a590-9486-46be-82d2-21ea4ec3c42e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 200 len: 1331 microversion: 2.1 time: 0.118743 May 11 21:09:53.133312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 340/691] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:52 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:53.339768 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-d6654f66-7cd1-440d-bbd7-6a5d89bd4f01 req-3ec4385a-0a16-49d9-beff-45b5112f103d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c477417-2e64-4722-ba8d-e9765385ff3f", "name": "network-vif-deleted", "tag": "6768c9cf-6579-4217-a3ff-b3ad7fd9951b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:53.347923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d6654f66-7cd1-440d-bbd7-6a5d89bd4f01 req-3ec4385a-0a16-49d9-beff-45b5112f103d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:53.348384 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-d6654f66-7cd1-440d-bbd7-6a5d89bd4f01 req-3ec4385a-0a16-49d9-beff-45b5112f103d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:53.361136 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-d6654f66-7cd1-440d-bbd7-6a5d89bd4f01 req-3ec4385a-0a16-49d9-beff-45b5112f103d service nova] Creating event network-vif-deleted:6768c9cf-6579-4217-a3ff-b3ad7fd9951b for instance 1c477417-2e64-4722-ba8d-e9765385ff3f on hv-cinder-84146 May 11 21:09:53.366697 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-d6654f66-7cd1-440d-bbd7-6a5d89bd4f01 req-3ec4385a-0a16-49d9-beff-45b5112f103d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030722 May 11 21:09:53.367634 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 352/692] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:53.973281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:53.974790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:53.998231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:53.998231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:53.998231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:53.998231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:54.111660 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:54.119057 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-82edc806-1a21-46f1-9dc1-337816d1d530 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1364 microversion: 2.1 time: 0.149837 May 11 21:09:54.119611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 341/693] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:53 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:54.140624 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:54.141313 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:54.148457 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:54.149162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:54.149962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:54.150399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:54.163827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f HTTP/1.1 May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:09:54.165447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:09:54.167008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '1c477417-2e64-4722-ba8d-e9765385ff3f'} May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:09:54.167765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:09:54.169456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:09:54.171160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:09:54.171160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-35832264-1bc1-4e8d-82a2-f258bdce9742 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 404 len: 111 microversion: 2.1 time: 0.030782 May 11 21:09:54.171160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 353/694] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:54 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:09:54.175869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-07d0153a-c26a-4792-bcf3-34b6c1c0fccb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '.version_select at 0x7ff89807fe50>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:54.258242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-07d0153a-c26a-4792-bcf3-34b6c1c0fccb tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789684130" status: 202 len: 0 microversion: 2.1 time: 0.086043 May 11 21:09:54.258884 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 342/695] 10.222.0.35 () {58 vars in 1217 bytes} [Wed May 11 21:09:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789684130 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:09:54.998147 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-08935efe-1b24-4d82-83f6-fc65be29c271 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: .version_select at 0x7ff898070790>, body: {"keypair": {"name": "tempest-keypair-1127879333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzlYhWuWhxLJZB3bfs6ERD8D/L3hoD0iFRI+HcmGRk3ujbbEuxXy+G9hPMwfEA3cARGJrBolEUzUiqhKHvN9dAJeFqIH5r9pr+ZTBcB5fxia9fT5dwJcr+YzKu0EHbI6g=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:55.011833 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-08935efe-1b24-4d82-83f6-fc65be29c271 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:09:55.015499 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-08935efe-1b24-4d82-83f6-fc65be29c271 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:09:55.089609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-08935efe-1b24-4d82-83f6-fc65be29c271 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095188 May 11 21:09:55.090215 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 354/696] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:09:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:55.135522 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:55.136127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:55.142429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:55.142809 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:55.143568 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:55.143996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:55.316306 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:55.323961 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8c67a4f7-6e32-42bd-bf6f-1476982375b9 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1364 microversion: 2.1 time: 0.192327 May 11 21:09:55.324521 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 343/697] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:55 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:55.382776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-a20ec65a-27b1-4c28-a615-588575bf0f21 req-96f07133-648e-4ff3-a0ec-bc8dddaac2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60", "tag": "12f6eed9-d209-452c-9d4a-069e1266f397"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:55.392611 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a20ec65a-27b1-4c28-a615-588575bf0f21 req-96f07133-648e-4ff3-a0ec-bc8dddaac2d2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:55.393029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a20ec65a-27b1-4c28-a615-588575bf0f21 req-96f07133-648e-4ff3-a0ec-bc8dddaac2d2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:55.403931 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-a20ec65a-27b1-4c28-a615-588575bf0f21 req-96f07133-648e-4ff3-a0ec-bc8dddaac2d2 service nova] Creating event network-changed:12f6eed9-d209-452c-9d4a-069e1266f397 for instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 on hv-cinder-84146 May 11 21:09:55.409261 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-a20ec65a-27b1-4c28-a615-588575bf0f21 req-96f07133-648e-4ff3-a0ec-bc8dddaac2d2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031778 May 11 21:09:55.409864 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 355/698] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:56.341462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:56.342157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:56.349028 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:56.349732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:56.350508 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:56.350937 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:56.771692 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:56.779087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5ceaa91d-3b5d-465f-8427-66b77b8ffd60 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1364 microversion: 2.1 time: 0.441522 May 11 21:09:56.779659 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 344/699] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:56 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1364 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:57.647923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1242498141", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93d70e35-28da-4d4e-9ed9-625e30aef3e3"}], "security_groups": [{"name": "tempest-securitygroup--1379482053"}], "key_name": "tempest-keypair-1127879333", "user_data": "}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:57.745522 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] validate_networks() for [('93d70e35-28da-4d4e-9ed9-625e30aef3e3', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:09:57.851315 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:57.852035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:57.858054 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:57.858495 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:57.859250 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:57.859678 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:57.990426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:57.997708 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4bcd77ad-d1ca-4fc2-bf53-9a71aa976094 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1364 microversion: 2.1 time: 0.206306 May 11 21:09:57.998242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 345/700] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:57 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:09:58.106753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:09:58.107171 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:09:58.107641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:09:58.108046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:09:58.108454 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:09:58.116827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:58.117270 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:58.118097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:58.118532 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:58.134797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:09:58.138659 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Getting quotas for user baed8aff24b64c788f40e6d7dd1f99c3 and project ad1ed05b84e545989b4753dab7bd4b3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:09:58.150017 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:09:58.152302 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:09:58.281435 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8a19e1b-0d64-43a5-9b07-0d0f30839a79 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.638594 May 11 21:09:58.282104 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 356/701] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:09:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:09:58.291805 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-eb25c7c9-4736-4ba5-8ddf-9735f0a6cb7c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:58.292406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-eb25c7c9-4736-4ba5-8ddf-9735f0a6cb7c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:58.344774 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-eb25c7c9-4736-4ba5-8ddf-9735f0a6cb7c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:58.351308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-eb25c7c9-4736-4ba5-8ddf-9735f0a6cb7c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1242 microversion: 2.1 time: 0.063250 May 11 21:09:58.351882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 346/702] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:58 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1242 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:58.865423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-8f7e4131-2177-46b1-8253-29e9c9199de3 req-bb46699c-7769-4097-9499-5ca0d121db9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60", "name": "network-vif-plugged", "status": "completed", "tag": "12f6eed9-d209-452c-9d4a-069e1266f397"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:09:58.875516 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-8f7e4131-2177-46b1-8253-29e9c9199de3 req-bb46699c-7769-4097-9499-5ca0d121db9f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:58.875958 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-8f7e4131-2177-46b1-8253-29e9c9199de3 req-bb46699c-7769-4097-9499-5ca0d121db9f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:58.886419 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-8f7e4131-2177-46b1-8253-29e9c9199de3 req-bb46699c-7769-4097-9499-5ca0d121db9f service nova] Creating event network-vif-plugged:12f6eed9-d209-452c-9d4a-069e1266f397 for instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 on hv-cinder-84146 May 11 21:09:58.891388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-8f7e4131-2177-46b1-8253-29e9c9199de3 req-bb46699c-7769-4097-9499-5ca0d121db9f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030955 May 11 21:09:58.891888 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 357/703] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:09:59.015115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:59.015720 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:59.022182 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:59.022633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:59.023395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:59.023828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:59.152616 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:59.160215 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c562fdd5-34a7-4f52-bca3-5c3e2c6c1e1a tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1364 microversion: 2.1 time: 0.149120 May 11 21:09:59.160928 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 347/704] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:59 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:09:59.368678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:09:59.369362 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:09:59.375445 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:59.375890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:59.376997 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:09:59.377429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:09:59.442036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:09:59.449247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8ec4ff43-23ed-4eb2-bc08-cbe2ef45873b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1246 microversion: 2.1 time: 0.084835 May 11 21:09:59.449837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 358/705] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:09:59 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:00.178157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:00.178778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:00.184936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:00.185384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:00.186191 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:00.186624 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:00.315012 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:00.323067 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0d6f908c-13d1-49ee-949e-e471782ef75b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1364 microversion: 2.1 time: 0.149316 May 11 21:10:00.328248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 348/706] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:00 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:00.466782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:00.467640 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:00.474875 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:00.475379 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:00.476130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:00.476625 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:00.507781 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-73c2b21b-c6f8-4349-92e2-3796118b31a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:00.508269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-73c2b21b-c6f8-4349-92e2-3796118b31a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:00.514120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73c2b21b-c6f8-4349-92e2-3796118b31a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:00.514569 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73c2b21b-c6f8-4349-92e2-3796118b31a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:00.515338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73c2b21b-c6f8-4349-92e2-3796118b31a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:00.515771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-73c2b21b-c6f8-4349-92e2-3796118b31a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:00.537126 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:00.538925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-73c2b21b-c6f8-4349-92e2-3796118b31a5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/ips" status: 200 len: 153 microversion: 2.20 time: 0.034971 May 11 21:10:00.539665 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 349/707] 10.222.0.35 () {60 vars in 1288 bytes} [Wed May 11 21:10:00 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 21:10:00.544787 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2e83c732-8f99-49ea-bd76-5f9c4fc11882 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1294 microversion: 2.1 time: 0.081901 May 11 21:10:00.545353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 359/708] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:00 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:01.340200 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:01.341690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:01.348531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:01.348986 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:01.349861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:01.350357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:01.480479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:01.489851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4bcdb018-4391-4f0c-862f-df248f1b13b2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1549 microversion: 2.1 time: 0.152934 May 11 21:10:01.490428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 350/709] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:01 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:01.507921 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-67080569-bb66-4e66-9ae0-8800baab6fa4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:01.508538 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-67080569-bb66-4e66-9ae0-8800baab6fa4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:01.517199 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67080569-bb66-4e66-9ae0-8800baab6fa4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:01.518974 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67080569-bb66-4e66-9ae0-8800baab6fa4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:01.520411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67080569-bb66-4e66-9ae0-8800baab6fa4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:01.521048 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-67080569-bb66-4e66-9ae0-8800baab6fa4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:01.562518 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:01.563126 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:01.570649 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:01.575129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:01.575129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:01.575129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:01.608810 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-67080569-bb66-4e66-9ae0-8800baab6fa4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105229 May 11 21:10:01.609388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 360/710] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:10:01 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:01.642585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:01.650297 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c09a654e-2e0e-4f44-82ca-3a4e5643e35f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1312 microversion: 2.1 time: 0.091682 May 11 21:10:01.650854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 351/711] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:01 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:02.581472 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:02.582631 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:02.589220 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:02.589685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:02.590458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:02.590888 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:02.615148 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lazy-loading 'flavor' on Instance uuid b2f00c24-95f0-4551-990e-c18813091765 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:10:02.667718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:02.669072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:02.675755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:02.676472 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:02.677450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:02.677911 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:02.835350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:02.843042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d4fa6c9d-d679-41d2-a136-1c5e8b896e26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.179103 May 11 21:10:02.843622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 352/712] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:02 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:02.848184 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-7f8cc573-0877-47d1-9e56-9eb0131349ea req-b66372c5-40ed-4014-b0b6-83ef0e6f6434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60", "tag": "12f6eed9-d209-452c-9d4a-069e1266f397"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:02.856516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7f8cc573-0877-47d1-9e56-9eb0131349ea req-b66372c5-40ed-4014-b0b6-83ef0e6f6434 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:02.856948 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-7f8cc573-0877-47d1-9e56-9eb0131349ea req-b66372c5-40ed-4014-b0b6-83ef0e6f6434 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:02.871517 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-7f8cc573-0877-47d1-9e56-9eb0131349ea req-b66372c5-40ed-4014-b0b6-83ef0e6f6434 service nova] Creating event network-changed:12f6eed9-d209-452c-9d4a-069e1266f397 for instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 on hv-cinder-84146 May 11 21:10:02.876764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-7f8cc573-0877-47d1-9e56-9eb0131349ea req-b66372c5-40ed-4014-b0b6-83ef0e6f6434 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031816 May 11 21:10:02.877392 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 353/713] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:03.195370 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7643e22b-dd10-4dc5-ad6e-6cf14ca8e7ec tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/action" status: 202 len: 0 microversion: 2.20 time: 0.618023 May 11 21:10:03.197582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 361/714] 10.222.0.35 () {62 vars in 1318 bytes} [Wed May 11 21:10:02 2022] POST /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 21:10:03.205292 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:03.206009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:03.213980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:03.214713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:03.216469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:03.217395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:03.366753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:03.376653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:03.379551 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:03.379978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7c734ee4-d873-4d76-b164-3d865c96d150 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.179002 May 11 21:10:03.380929 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 354/715] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:03 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:03.454921 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-3b1371d0-9d6d-4302-ab5d-d24e726a44f0 req-bc6e8b72-f5b0-471a-a59c-6d07033dff18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7674641c-2723-4ec9-84c9-6570d3c5b5de", "tag": "a9d8e283-e472-4b3a-9210-66b4191723d1"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:03.464795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-3b1371d0-9d6d-4302-ab5d-d24e726a44f0 req-bc6e8b72-f5b0-471a-a59c-6d07033dff18 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:03.472336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-3b1371d0-9d6d-4302-ab5d-d24e726a44f0 req-bc6e8b72-f5b0-471a-a59c-6d07033dff18 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:03.489969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-3b1371d0-9d6d-4302-ab5d-d24e726a44f0 req-bc6e8b72-f5b0-471a-a59c-6d07033dff18 service nova] Creating event network-changed:a9d8e283-e472-4b3a-9210-66b4191723d1 for instance 7674641c-2723-4ec9-84c9-6570d3c5b5de on hv-cinder-84146 May 11 21:10:03.495370 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-3b1371d0-9d6d-4302-ab5d-d24e726a44f0 req-bc6e8b72-f5b0-471a-a59c-6d07033dff18 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047659 May 11 21:10:03.498652 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 362/716] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:03.915989 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:03.918426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:03.922767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:03.923344 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:03.924182 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:03.924832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:04.054666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:04.061911 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e4ea6402-4b9d-45fe-a740-5a8c8b034120 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.205450 May 11 21:10:04.062479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 355/717] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:03 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:04.400407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:04.401100 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:04.407243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:04.407711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:04.408477 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:04.408910 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:04.594822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:04.602497 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:04.603978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:04.605119 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8756088e-e236-4ce1-a5aa-33308ccb38ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.209838 May 11 21:10:04.605830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 363/718] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:04 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:05.079401 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:05.080002 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:05.086326 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:05.086767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:05.087523 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:05.087954 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:05.212023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:05.219105 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ca746d5c-bc7a-45a4-9df8-e07aa855117b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.143600 May 11 21:10:05.219663 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 356/719] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:05 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:05.723421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:05.724031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:05.729829 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:05.730278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:05.731037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:05.731476 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:05.856385 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:05.864567 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:05.866076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:05.867206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2ff8276d-ea7a-4b29-ba39-4a8724c6cf7c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.247764 May 11 21:10:05.867759 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 364/720] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:05 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:06.236564 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:06.237112 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:06.243965 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:06.244417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:06.245179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:06.245646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:06.374385 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:06.381725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f9d23d5b-03f7-4c13-b541-1807bb4ebac7 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.149076 May 11 21:10:06.382288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 357/721] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:06 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:06.884051 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:06.884779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:06.891065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:06.891517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:06.892288 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:06.892723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:07.029879 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:07.037717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:07.039370 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:07.040503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-37a1b648-2040-4113-8cf3-ecd68f4b6f4b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.160297 May 11 21:10:07.041058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 365/722] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:06 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:07.398430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:07.399085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:07.405704 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:07.406156 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:07.406924 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:07.407361 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:07.530579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:07.537748 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-31b150a5-3a4f-406e-8add-97fdd04401d0 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.143062 May 11 21:10:07.538311 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 358/723] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:07 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:08.058887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:08.059518 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:08.065806 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:08.066260 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:08.067076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:08.067513 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:08.198205 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:08.206175 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:08.207663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:08.208829 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-01bb6aa1-efb1-4f03-b841-bafd1faab354 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.153904 May 11 21:10:08.209379 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 366/724] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:08 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:08.555108 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:08.555720 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:08.561975 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:08.562425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:08.563188 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:08.563621 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:08.688750 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:08.695955 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2e2be0fb-d312-4aab-99df-347538f453da tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.145373 May 11 21:10:08.696518 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 359/725] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:08 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:08.978449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-033586ae-0f39-4907-8d55-be1b178e6016 req-ab86dab6-0660-4f75-afde-f950b9b30ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7674641c-2723-4ec9-84c9-6570d3c5b5de", "name": "network-vif-plugged", "status": "completed", "tag": "a9d8e283-e472-4b3a-9210-66b4191723d1"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:08.986530 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-033586ae-0f39-4907-8d55-be1b178e6016 req-ab86dab6-0660-4f75-afde-f950b9b30ec2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:08.986977 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-033586ae-0f39-4907-8d55-be1b178e6016 req-ab86dab6-0660-4f75-afde-f950b9b30ec2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:08.999502 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-033586ae-0f39-4907-8d55-be1b178e6016 req-ab86dab6-0660-4f75-afde-f950b9b30ec2 service nova] Creating event network-vif-plugged:a9d8e283-e472-4b3a-9210-66b4191723d1 for instance 7674641c-2723-4ec9-84c9-6570d3c5b5de on hv-cinder-84146 May 11 21:10:09.004326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-033586ae-0f39-4907-8d55-be1b178e6016 req-ab86dab6-0660-4f75-afde-f950b9b30ec2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 May 11 21:10:09.005003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 367/726] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:09.227711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:09.228397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:09.234495 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:09.234968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:09.235719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:09.236146 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:09.364082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:09.371926 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:09.373392 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:09.374591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-75f8a9da-04cd-4cb5-862f-0048972e077b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.151524 May 11 21:10:09.375144 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 360/727] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:09 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:09.713475 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:09.714285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:09.720305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:09.720779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:09.721558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:09.721990 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:09.848940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:09.856125 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-769784e5-60fc-4137-8df0-f058924acc86 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.147222 May 11 21:10:09.856673 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 368/728] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:09 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:10.393025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:10.393653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:10.400790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:10.401231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:10.402011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:10.402442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:10.530163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:10.538639 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:10.540118 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:10.541265 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5baece6f-eed5-40db-bf31-8d7cb66ea105 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.152125 May 11 21:10:10.541870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 361/729] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:10 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:10.873211 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:10.873846 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:10.880677 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:10.881128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:10.881973 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:10.882411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:11.007566 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:11.014786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e7116966-50a7-46c5-8762-6c39f8b04bca tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1368 microversion: 2.1 time: 0.145463 May 11 21:10:11.015373 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 369/730] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:10 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:11.559569 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:11.560201 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:11.566445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:11.566893 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:11.567653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:11.568084 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:11.694938 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:11.702646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:11.704331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:11.705281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e0322f26-0710-48e9-8b7a-d083f59985ed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.149612 May 11 21:10:11.705867 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 362/731] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:11 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:12.031923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:12.032532 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:12.039506 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:12.039952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:12.040709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:12.041140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:12.169197 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:12.177086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3d56f1a3-b746-47ff-b47d-a23e2ccd7845 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1558 microversion: 2.1 time: 0.148282 May 11 21:10:12.177659 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 370/732] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:12 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:12.198583 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4fcd0255-9fe3-4d53-a75e-66b25fe4fb66 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:12.199065 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4fcd0255-9fe3-4d53-a75e-66b25fe4fb66 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:12.204776 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fcd0255-9fe3-4d53-a75e-66b25fe4fb66 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:12.205213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fcd0255-9fe3-4d53-a75e-66b25fe4fb66 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:12.205998 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fcd0255-9fe3-4d53-a75e-66b25fe4fb66 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:12.206424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fcd0255-9fe3-4d53-a75e-66b25fe4fb66 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:12.279667 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4fcd0255-9fe3-4d53-a75e-66b25fe4fb66 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.084751 May 11 21:10:12.280272 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 363/733] 10.222.0.35 () {58 vars in 1274 bytes} [Wed May 11 21:10:12 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-interface => generated 285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:12.723975 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:12.724482 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:12.730282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:12.730725 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:12.731477 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:12.731905 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:12.858515 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:12.866300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:12.867817 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:12.868951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fafb3914-978d-4bf6-b025-bd736a095328 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.149530 May 11 21:10:12.869501 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 371/734] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:12 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:13.559985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-b6ba5619-6db0-4136-bf32-4c3b218412f8 req-23957445-5143-4705-be85-150db2f9fdb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7674641c-2723-4ec9-84c9-6570d3c5b5de", "tag": "a9d8e283-e472-4b3a-9210-66b4191723d1"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:13.568340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-b6ba5619-6db0-4136-bf32-4c3b218412f8 req-23957445-5143-4705-be85-150db2f9fdb3 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:13.568779 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-b6ba5619-6db0-4136-bf32-4c3b218412f8 req-23957445-5143-4705-be85-150db2f9fdb3 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:13.579347 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-b6ba5619-6db0-4136-bf32-4c3b218412f8 req-23957445-5143-4705-be85-150db2f9fdb3 service nova] Creating event network-changed:a9d8e283-e472-4b3a-9210-66b4191723d1 for instance 7674641c-2723-4ec9-84c9-6570d3c5b5de on hv-cinder-84146 May 11 21:10:13.584625 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-b6ba5619-6db0-4136-bf32-4c3b218412f8 req-23957445-5143-4705-be85-150db2f9fdb3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082043 May 11 21:10:13.585225 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 364/735] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:13.886906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:13.887505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:13.893723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:13.894429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:13.895223 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:13.895835 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:14.087482 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:14.098936 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:14.100578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:14.101785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a6e012a0-5619-45f2-ae66-2fa31002bfe8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1744 microversion: 2.20 time: 0.218668 May 11 21:10:14.102539 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 372/736] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:13 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:15.121435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:15.122168 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:15.128241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:15.128685 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:15.129445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:15.129905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:15.266565 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:15.275713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:15.277182 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:15.278425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-06153a79-794d-4fae-837e-f15f3802cffa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1744 microversion: 2.20 time: 0.161696 May 11 21:10:15.279135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 365/737] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:15 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:16.296400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:16.297113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:16.305006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:16.305460 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:16.306328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:16.306766 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:16.440797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:16.449221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:16.450757 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:16.451903 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f5e1851b-f365-4000-8ed1-09bb2d2730b8 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.159405 May 11 21:10:16.452455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 373/738] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:16 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:16.947896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-bd38b0f2-071e-4b13-842d-cc13d4ab6b7c req-dac94f7f-9f9b-4676-8955-adf1b31fcb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f00c24-95f0-4551-990e-c18813091765", "name": "network-vif-plugged", "status": "completed", "tag": "f03f2724-557a-44bf-a2f6-34c8f1d25081"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:16.956590 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-bd38b0f2-071e-4b13-842d-cc13d4ab6b7c req-dac94f7f-9f9b-4676-8955-adf1b31fcb79 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:16.957034 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-bd38b0f2-071e-4b13-842d-cc13d4ab6b7c req-dac94f7f-9f9b-4676-8955-adf1b31fcb79 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:16.973139 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-bd38b0f2-071e-4b13-842d-cc13d4ab6b7c req-dac94f7f-9f9b-4676-8955-adf1b31fcb79 service nova] Creating event network-vif-plugged:f03f2724-557a-44bf-a2f6-34c8f1d25081 for instance b2f00c24-95f0-4551-990e-c18813091765 on hv-cinder-84146 May 11 21:10:16.978364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-bd38b0f2-071e-4b13-842d-cc13d4ab6b7c req-dac94f7f-9f9b-4676-8955-adf1b31fcb79 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034586 May 11 21:10:16.978989 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 366/739] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:17.470832 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:17.472048 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:17.478784 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:17.479236 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:17.480005 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:17.480661 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:17.621023 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:17.628792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:17.630310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:17.631651 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b2f49d8c-82e2-4717-8fa7-c4294670d45c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.164701 May 11 21:10:17.632205 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 374/740] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:17 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:18.651468 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:18.652752 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:18.659443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:18.659996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:18.660781 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:18.661209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:18.807472 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:18.818592 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:18.820590 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:18.822088 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5fe56b43-e0a6-43e0-bf66-2898f612b153 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.175570 May 11 21:10:18.823451 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 367/741] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:18 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:19.841575 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:19.841575 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:20.007785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:20.007785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:20.007785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:20.007785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:20.008951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:20.011006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:20.012518 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:20.013695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1ac16688-6279-477f-bfd2-4f2fe2b941fa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.177416 May 11 21:10:20.014444 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 375/742] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:19 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:21.032286 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:21.032905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:21.040442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:21.041009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:21.041829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:21.042271 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:21.181852 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:21.191646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:21.193192 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:21.194419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-03efb9a4-a1fa-4040-87ca-8b4374da4bc4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.166253 May 11 21:10:21.194980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 368/743] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:21 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:22.212249 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:22.213631 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:22.220911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:22.221445 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:22.222326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:22.223631 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:22.360344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:22.369458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:22.370976 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:22.372214 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-72759cb7-0a62-4400-b964-fc4b43706129 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.163936 May 11 21:10:22.372815 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 376/744] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:22 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:23.390944 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:23.392301 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:23.399174 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:23.399886 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:23.400657 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:23.401439 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:23.546505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:23.555438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:23.556940 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:23.559945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1ef0d4cd-e587-43d3-b4f5-fe4355b4e285 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.171513 May 11 21:10:23.559945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 369/745] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:23 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:10:24.579237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:24.580499 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:24.587382 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:24.587836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:24.588859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:24.589304 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:24.732911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:24.741267 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:24.742799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:24.743960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b5fbfed3-8cf2-4add-8810-44e4adeb5c32 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.168595 May 11 21:10:24.755531 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 377/746] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:24 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:25.763340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:25.763945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:25.770106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:25.771536 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:25.772321 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:25.772804 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:25.901977 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:25.909613 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:25.911796 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:25.912948 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b14da86c-e961-41b5-813e-d6c1ae42603b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.154309 May 11 21:10:25.913511 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 370/747] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:25 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:26.931185 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:26.931780 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:26.938009 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:26.938454 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:26.939250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:26.939678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:27.069863 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:27.077797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:27.079271 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:27.080409 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1cbd6d0c-65fc-4154-a4e7-d5d5721aab08 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1739 microversion: 2.20 time: 0.153160 May 11 21:10:27.080960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 378/748] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:26 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:27.233732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:27.234263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:27.240449 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:27.240893 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:27.241679 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:27.242113 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:27.318870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lazy-loading 'services' on Instance uuid 6afa6104-9267-474c-aa59-3e38d5636e78 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:10:27.604220 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4f791823-91b5-47a8-b36c-477f8af11360 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments/a8bbb4df-a3f1-41de-b802-1565a04a6384" status: 202 len: 0 microversion: 2.1 time: 0.374218 May 11 21:10:27.604848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 371/749] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:10:27 2022] DELETE /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments/a8bbb4df-a3f1-41de-b802-1565a04a6384 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:10:27.613775 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6575fe82-3954-44fc-b035-854f3d8650c9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:27.614987 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6575fe82-3954-44fc-b035-854f3d8650c9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:27.620907 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6575fe82-3954-44fc-b035-854f3d8650c9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:27.621338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6575fe82-3954-44fc-b035-854f3d8650c9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:27.622152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6575fe82-3954-44fc-b035-854f3d8650c9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:27.622714 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6575fe82-3954-44fc-b035-854f3d8650c9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:27.651783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6575fe82-3954-44fc-b035-854f3d8650c9 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042494 May 11 21:10:27.652348 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 379/750] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:10:27 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:28.101693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:28.102395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:28.108454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:28.108899 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:28.109690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:28.110129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:28.237472 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:28.245632 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:28.247121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:28.248269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6fda8ab9-66d1-4b9a-922b-1a4cbe86b98d tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1721 microversion: 2.20 time: 0.150829 May 11 21:10:28.248834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 372/751] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:28 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:28.663572 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3d67c316-f055-4515-a429-1aa68aa4afca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:28.664393 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3d67c316-f055-4515-a429-1aa68aa4afca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:28.670701 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d67c316-f055-4515-a429-1aa68aa4afca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:28.671149 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d67c316-f055-4515-a429-1aa68aa4afca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:28.671910 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d67c316-f055-4515-a429-1aa68aa4afca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:28.672340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d67c316-f055-4515-a429-1aa68aa4afca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:28.701912 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3d67c316-f055-4515-a429-1aa68aa4afca tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 May 11 21:10:28.702462 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 380/752] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:10:28 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:29.267071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:29.267668 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:29.274414 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:29.275121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:29.275871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:29.276300 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:29.399428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:29.407573 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:29.409056 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:29.410229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1c5f64cf-5c65-4dbc-a5df-6601073adbd6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1721 microversion: 2.20 time: 0.146998 May 11 21:10:29.410796 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 373/753] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:29 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:29.713926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6fe6706f-4b2d-4528-93c2-5c05e536d19d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:29.714866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6fe6706f-4b2d-4528-93c2-5c05e536d19d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:29.721064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6fe6706f-4b2d-4528-93c2-5c05e536d19d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:29.721554 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6fe6706f-4b2d-4528-93c2-5c05e536d19d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:29.722304 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6fe6706f-4b2d-4528-93c2-5c05e536d19d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:29.722735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6fe6706f-4b2d-4528-93c2-5c05e536d19d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:29.749807 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6fe6706f-4b2d-4528-93c2-5c05e536d19d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039839 May 11 21:10:29.750340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 381/754] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:10:29 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:30.428150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:30.428778 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:30.435109 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:30.435551 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:30.436302 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:30.436731 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:30.564227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:30.572347 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:30.573861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:30.574996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ee2e25b1-3d16-4a3c-be1b-c77cb762b3c0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1721 microversion: 2.20 time: 0.150730 May 11 21:10:30.575538 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 374/755] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:30 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:30.761008 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b6677cca-2ab7-408d-8c78-c7ed1ca1267f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:30.761990 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b6677cca-2ab7-408d-8c78-c7ed1ca1267f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:30.768335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6677cca-2ab7-408d-8c78-c7ed1ca1267f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:30.768783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6677cca-2ab7-408d-8c78-c7ed1ca1267f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:30.769671 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6677cca-2ab7-408d-8c78-c7ed1ca1267f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:30.770111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b6677cca-2ab7-408d-8c78-c7ed1ca1267f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:30.799552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b6677cca-2ab7-408d-8c78-c7ed1ca1267f tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043115 May 11 21:10:30.800202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 382/756] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:10:30 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:10:30.867280 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:30.867781 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:30.873892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:30.874333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:30.875106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:30.875542 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:30.902465 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:10:31.022061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-37262134-4352-42d5-8752-110b44ceae33 req-d0488bde-6719-47ba-822e-b2758ff1562a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f00c24-95f0-4551-990e-c18813091765", "name": "network-vif-unplugged", "status": "completed", "tag": "f03f2724-557a-44bf-a2f6-34c8f1d25081"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:31.030227 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-37262134-4352-42d5-8752-110b44ceae33 req-d0488bde-6719-47ba-822e-b2758ff1562a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:31.030662 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-37262134-4352-42d5-8752-110b44ceae33 req-d0488bde-6719-47ba-822e-b2758ff1562a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:31.042827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-37262134-4352-42d5-8752-110b44ceae33 req-d0488bde-6719-47ba-822e-b2758ff1562a service nova] Creating event network-vif-unplugged:f03f2724-557a-44bf-a2f6-34c8f1d25081 for instance b2f00c24-95f0-4551-990e-c18813091765 on hv-cinder-84146 May 11 21:10:31.047763 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-37262134-4352-42d5-8752-110b44ceae33 req-d0488bde-6719-47ba-822e-b2758ff1562a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083149 May 11 21:10:31.048379 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 383/757] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:10:31.174077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4fb36c36-06e5-4c26-b09e-cdc5d3536357 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "DELETE /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 204 len: 0 microversion: 2.1 time: 0.311059 May 11 21:10:31.174669 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 375/758] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:10:30 2022] DELETE /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:10:31.183780 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:31.184510 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:31.190667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:31.191118 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:31.191877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:31.192314 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:31.319110 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:31.326502 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0be29226-ebfa-4fbf-9b08-82b46180d971 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1689 microversion: 2.1 time: 0.146945 May 11 21:10:31.327070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 384/759] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:31 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:31.594073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:31.594758 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:31.601602 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:31.602046 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:31.602800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:31.603227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:31.728552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:31.736297 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:31.737880 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:31.739023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d7bdfb01-c264-4251-aceb-cf5608851008 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1664 microversion: 2.20 time: 0.149222 May 11 21:10:31.739572 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 376/760] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:31 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:31.756985 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4a976250-76fc-4b68-bf46-32aa080fb3e5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36e7504b-05c8-4bde-b16d-04232ee31cdb"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:31.758124 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4a976250-76fc-4b68-bf46-32aa080fb3e5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:31.764038 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a976250-76fc-4b68-bf46-32aa080fb3e5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:31.764616 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a976250-76fc-4b68-bf46-32aa080fb3e5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:31.765269 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a976250-76fc-4b68-bf46-32aa080fb3e5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:31.765735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a976250-76fc-4b68-bf46-32aa080fb3e5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:32.343254 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:32.343855 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:32.349653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:32.350211 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:32.350965 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:32.351394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:32.479514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:32.486782 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a92fa0c3-1684-4f7a-8088-4c05935b5044 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1689 microversion: 2.1 time: 0.147461 May 11 21:10:32.487353 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 377/761] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:32 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:32.775517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4a976250-76fc-4b68-bf46-32aa080fb3e5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.022706 May 11 21:10:32.776057 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 385/762] 10.222.0.35 () {62 vars in 1363 bytes} [Wed May 11 21:10:31 2022] POST /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-volume_attachments => generated 188 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 21:10:32.885339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-44dc7d7c-104d-4eee-a05e-afe7834d5e29 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:32.887798 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-44dc7d7c-104d-4eee-a05e-afe7834d5e29 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:32.903233 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44dc7d7c-104d-4eee-a05e-afe7834d5e29 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:32.903681 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44dc7d7c-104d-4eee-a05e-afe7834d5e29 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:32.904445 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44dc7d7c-104d-4eee-a05e-afe7834d5e29 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:32.904882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44dc7d7c-104d-4eee-a05e-afe7834d5e29 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:33.504455 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:33.504974 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:33.512183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:33.512622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:33.513373 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:33.513864 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:33.578923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-44dc7d7c-104d-4eee-a05e-afe7834d5e29 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-volume_attachments/36e7504b-05c8-4bde-b16d-04232ee31cdb" status: 202 len: 0 microversion: 2.20 time: 0.697530 May 11 21:10:33.579683 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 378/763] 10.222.0.35 () {60 vars in 1456 bytes} [Wed May 11 21:10:32 2022] DELETE /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-volume_attachments/36e7504b-05c8-4bde-b16d-04232ee31cdb => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 21:10:33.634952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8fcb21cc-294a-4766-ab2d-20d4eaf04d90 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:33.635523 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8fcb21cc-294a-4766-ab2d-20d4eaf04d90 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:33.641238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fcb21cc-294a-4766-ab2d-20d4eaf04d90 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:33.641729 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fcb21cc-294a-4766-ab2d-20d4eaf04d90 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:33.642498 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fcb21cc-294a-4766-ab2d-20d4eaf04d90 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:33.642927 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fcb21cc-294a-4766-ab2d-20d4eaf04d90 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:33.645347 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:33.652882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-94dfdf81-58db-4d23-88cf-891a4f9ac543 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1689 microversion: 2.1 time: 0.152375 May 11 21:10:33.653605 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 386/764] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:33 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:33.932754 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8fcb21cc-294a-4766-ab2d-20d4eaf04d90 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "POST /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/action" status: 202 len: 0 microversion: 2.20 time: 0.302212 May 11 21:10:33.936187 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 379/765] 10.222.0.35 () {62 vars in 1318 bytes} [Wed May 11 21:10:33 2022] POST /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 21:10:33.941272 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:33.941902 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:33.948006 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:33.948449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:33.949204 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:33.949657 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:34.076197 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:34.083909 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:34.085380 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:34.086529 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f97a56eb-1084-4962-8efa-ca5f7c392b30 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1672 microversion: 2.20 time: 0.149128 May 11 21:10:34.087080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 387/766] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:33 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:34.670844 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:34.671452 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:34.679095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:34.680598 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:34.681732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:34.682331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:34.805714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:34.813710 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-71c4216e-94d8-44e3-9180-38c7c2bf3a84 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1689 microversion: 2.1 time: 0.147058 May 11 21:10:34.814220 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 380/767] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:34 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:35.105751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:35.106466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:35.113633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:35.114080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:35.114845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:35.115275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:35.322414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:35.330258 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:35.331663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:35.332789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-76471b36-77c0-4d58-bf26-769a72b025b6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1674 microversion: 2.20 time: 0.231852 May 11 21:10:35.333351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 388/768] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:35 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1674 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:35.830762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:35.831303 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:35.837574 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:35.838027 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:35.838796 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:35.839232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:35.965921 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:35.969454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-83a49256-04db-4c61-9e36-ee667c66eae3 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1621 microversion: 2.1 time: 0.140491 May 11 21:10:35.970260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 381/769] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:35 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1621 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:36.026930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-a807951d-b991-4ad4-adf1-f36cb29a1f1d req-3f50b688-b6bd-4ba7-a37a-addcf205c415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa6104-9267-474c-aa59-3e38d5636e78", "name": "network-vif-deleted", "tag": "aa313336-1ef9-41c8-900a-4471c553fd70"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:36.036260 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a807951d-b991-4ad4-adf1-f36cb29a1f1d req-3f50b688-b6bd-4ba7-a37a-addcf205c415 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:36.036712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-a807951d-b991-4ad4-adf1-f36cb29a1f1d req-3f50b688-b6bd-4ba7-a37a-addcf205c415 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:36.052083 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-a807951d-b991-4ad4-adf1-f36cb29a1f1d req-3f50b688-b6bd-4ba7-a37a-addcf205c415 service nova] Creating event network-vif-deleted:aa313336-1ef9-41c8-900a-4471c553fd70 for instance 6afa6104-9267-474c-aa59-3e38d5636e78 on hv-cinder-84146 May 11 21:10:36.057886 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-a807951d-b991-4ad4-adf1-f36cb29a1f1d req-3f50b688-b6bd-4ba7-a37a-addcf205c415 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126215 May 11 21:10:36.058830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 389/770] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:36.352371 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:36.353067 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:36.359207 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:36.359741 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:36.360587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:36.361028 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:36.493391 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:36.501121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:36.502664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:36.503757 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7a41b121-30b1-4f4b-b295-a720d12d0627 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.155929 May 11 21:10:36.504314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 382/771] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:36 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:10:36.987915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:36.988601 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:36.994882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:36.995334 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:36.996128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:36.996557 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:37.029132 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:37.029473 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:37.029958 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lazy-loading 'fault' on Instance uuid 6afa6104-9267-474c-aa59-3e38d5636e78 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:10:37.071152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:37.078259 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8cd69c2-db7b-4b23-90fc-5e49fd2345af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 200 len: 1335 microversion: 2.1 time: 0.095071 May 11 21:10:37.079021 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 390/772] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:36 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:37.522139 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:37.523541 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:37.530773 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:37.531319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:37.532167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:37.532665 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:37.669039 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:37.677518 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:37.680490 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:37.680926 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3389db7b-b8b2-490d-b1b9-ecf87973a1c2 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.162560 May 11 21:10:37.681327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 383/773] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:37 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:38.096083 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:38.096629 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 6afa6104-9267-474c-aa59-3e38d5636e78] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:38.103511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:38.103954 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:38.104711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:38.105143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:38.118414 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] HTTP exception thrown: Instance 6afa6104-9267-474c-aa59-3e38d5636e78 could not be found. May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Request method failure captured: May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 HTTP/1.1 May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCU-pZ8tTrn9OY2Wc4uDkMAlSJqVCr0KLJNOPdapQhLJnNgi_BS7FnKDFSmdGsxSkqXTmNbCv3QEP91gQC6euwQlfmKwCri1evt8cU_1IjIFdX0DbxC6AzKqf9D-w1wqg2naT3dlzBmznTHUWI1p14O6BzSFn-_y1NdwMhiZ9fKOshk May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:10:38.120065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/838ec035db164e50bc335d2cf141d943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_838ec035db164e50bc335d2cf141d943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: df9d6a9b73e64e31b014b5809912bbe8 May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 6afa6104-9267-474c-aa59-3e38d5636e78 could not be found. May 11 21:10:38.121579 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '6afa6104-9267-474c-aa59-3e38d5636e78'} May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afa6104-9267-474c-aa59-3e38d5636e78 could not be found. May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:10:38.122410 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afa6104-9267-474c-aa59-3e38d5636e78 could not be found. May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afa6104-9267-474c-aa59-3e38d5636e78 could not be found. May 11 21:10:38.123770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:38.124887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Returning 404 to user: Instance 6afa6104-9267-474c-aa59-3e38d5636e78 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:10:38.124887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-606576d6-0575-4253-932a-99ac0210c297 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78" status: 404 len: 111 microversion: 2.1 time: 0.029316 May 11 21:10:38.124887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 391/774] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:38 2022] GET /compute/v2.1/servers/6afa6104-9267-474c-aa59-3e38d5636e78 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:10:38.130022 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-31a60511-f41e-4dfb-a653-65900507e15a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '.version_select at 0x7ff89801a280>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:38.206681 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-31a60511-f41e-4dfb-a653-65900507e15a tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554350879" status: 202 len: 0 microversion: 2.1 time: 0.080221 May 11 21:10:38.207791 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 384/775] 10.222.0.35 () {58 vars in 1217 bytes} [Wed May 11 21:10:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554350879 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:10:38.699920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:38.700525 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:38.706752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:38.709839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:38.712104 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:38.712658 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:39.162524 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:39.170957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:39.172407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:39.174871 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2836d063-441b-44af-add0-90bc9864396f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.478982 May 11 21:10:39.175956 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 392/776] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:38 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:40.194516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:40.195861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:40.202329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:40.202773 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:40.203535 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:40.203964 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:40.338976 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:40.346966 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:40.348477 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:40.349672 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-761deb5c-79bf-47d3-ba33-c08c2b8e5ebe tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.159767 May 11 21:10:40.350598 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 385/777] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:40 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:10:41.369325 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:41.369970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:41.376640 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:41.377497 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:41.378338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:41.378778 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:41.513976 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:41.521687 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:41.523337 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:41.524605 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-779150c3-3282-445b-a007-97f35d994ebf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.159976 May 11 21:10:41.525597 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 393/778] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:41 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:41.880454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:41.881668 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:41.888942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:41.889474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:41.890585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:41.891348 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:41.927412 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:10:42.328623 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-69fcaadc-0d38-48a0-94c2-21defc7d5193 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "DELETE /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 204 len: 0 microversion: 2.1 time: 0.452748 May 11 21:10:42.329216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 386/779] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:10:41 2022] DELETE /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:10:42.337825 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:42.338434 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:42.344609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:42.345058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:42.345867 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:42.346304 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:42.478899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:42.487443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b1d41057-3f18-436e-995d-90639bed8d16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.153517 May 11 21:10:42.488649 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 394/780] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:42 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:42.545508 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:42.546231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:42.552282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:42.552763 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:42.553549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:42.553991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:42.691339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:42.701435 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:42.702872 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:42.704022 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4d838d1f-392e-4d0c-bbb6-5c4026c5eeed tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.162959 May 11 21:10:42.704584 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 387/781] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:42 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:43.505749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:43.506424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:43.512628 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:43.513078 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:43.513880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:43.514318 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:43.651311 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:43.664083 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f8ec6b47-a7d2-41b7-92c7-1a78ed322244 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.161540 May 11 21:10:43.665010 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 395/782] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:43 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:43.722409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:43.723285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:43.730289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:43.730761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:43.731702 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:43.732168 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:43.878787 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:43.888438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:43.890021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:43.891183 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2d76e9d0-5f3d-48e1-9368-9fdc5d5d4033 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.172865 May 11 21:10:43.891739 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 388/783] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:43 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:44.681594 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:44.682321 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:44.688275 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:44.688726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:44.689491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:44.689955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:44.829633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:44.837853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-eb5ff224-15fc-4eef-96d6-7e0cd1c2c35d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.160209 May 11 21:10:44.838423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 396/784] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:44 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:44.912591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:44.913310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:44.922552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:44.923054 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:44.923930 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:44.924364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:45.078863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:45.088317 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:45.089923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:45.091343 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-08216ec2-66a3-43ce-a1d2-48f747f1f9be tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.183620 May 11 21:10:45.102888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 389/785] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:44 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:45.855015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:45.855617 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:45.861899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:45.862345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:45.863095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:45.863521 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:45.992117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:45.999475 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-911e3080-00de-4797-b5ab-00731b74bf16 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.148934 May 11 21:10:46.000031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 397/786] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:45 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:46.109314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:46.109936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:46.116111 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:46.116553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:46.117306 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:46.117761 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:46.240369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:46.247941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:46.249446 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:46.250610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4744cfdd-147e-4d64-ae56-c2f4b7e24ab4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.145294 May 11 21:10:46.251169 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 390/787] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:46 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:46.685002 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-65fa6e28-1c13-4bcf-9581-b2f770da14bd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:46.685486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-65fa6e28-1c13-4bcf-9581-b2f770da14bd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:46.691377 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65fa6e28-1c13-4bcf-9581-b2f770da14bd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:46.691852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65fa6e28-1c13-4bcf-9581-b2f770da14bd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:46.692613 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65fa6e28-1c13-4bcf-9581-b2f770da14bd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:46.693061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-65fa6e28-1c13-4bcf-9581-b2f770da14bd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:46.715050 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-65fa6e28-1c13-4bcf-9581-b2f770da14bd tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/ips" status: 200 len: 145 microversion: 2.1 time: 0.033834 May 11 21:10:46.715538 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 398/788] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:10:46 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/ips => generated 145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:46.796228 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:46.796923 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:46.802653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:46.803103 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:46.804537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:46.804976 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:46.828963 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:10:47.016757 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:47.017320 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:47.024300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:47.024865 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:47.026069 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:47.026505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:47.154590 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:47.162026 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1685f269-2238-48ed-8a88-f2e5c854c8a6 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.149055 May 11 21:10:47.162584 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 399/789] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:47 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:47.165085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-52db7522-97f8-4abd-976a-a218acc6c281 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 204 len: 0 microversion: 2.1 time: 0.372395 May 11 21:10:47.165691 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 391/790] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:10:46 2022] DELETE /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:10:47.174647 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:47.175253 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:47.181060 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:47.183937 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:47.183937 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:47.183937 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:47.269725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:47.270837 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:47.278990 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:47.279664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:47.280783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:47.281411 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:47.321655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:47.329181 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-79907367-9549-4177-8e82-1737cd631390 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1578 microversion: 2.1 time: 0.158144 May 11 21:10:47.329777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 400/791] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:47 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:47.415831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:47.423749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:47.425313 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:47.426491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d2c7d5d7-3d03-436d-bd27-df41c9027e7e tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.161164 May 11 21:10:47.427048 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 392/792] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:47 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:10:48.180269 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:48.180814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:48.187078 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.187529 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.188293 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.188729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.314773 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:48.322044 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-32728c6d-dba2-4a17-873d-97c03eb46f23 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.146310 May 11 21:10:48.322608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 401/793] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:48 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:48.354083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:48.354083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:48.354083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.354083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.355241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.355241 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.359721 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-439cd6c9-ab88-4f6f-9b9b-9f61dec57ba3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "954b9c15-cff9-4576-be7b-a3b567e31688"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:48.360846 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-439cd6c9-ab88-4f6f-9b9b-9f61dec57ba3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:48.367354 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439cd6c9-ab88-4f6f-9b9b-9f61dec57ba3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.367796 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439cd6c9-ab88-4f6f-9b9b-9f61dec57ba3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.368558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439cd6c9-ab88-4f6f-9b9b-9f61dec57ba3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.368993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-439cd6c9-ab88-4f6f-9b9b-9f61dec57ba3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.561775 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:48.570579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-59a5e8cf-73cf-43cd-9cc7-e5b461eba8f3 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1578 microversion: 2.1 time: 0.228436 May 11 21:10:48.571181 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 393/794] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:48 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:48.575713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:48.576309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:48.581762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.582205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.582959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:48.583388 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:48.707998 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:48.715538 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:48.717033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:48.718199 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a12f94fc-6254-44cc-99e0-617c48e0babf tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.146126 May 11 21:10:48.718756 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 394/795] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:48 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:49.339470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:49.340166 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:49.346069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:49.346519 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:49.347279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:49.347713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:49.476356 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:49.483670 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-441ea63e-80bc-47a7-a2fc-1745ca1651d8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.148559 May 11 21:10:49.484236 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 395/796] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:49 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:49.586670 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:49.587280 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:49.593061 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:49.593513 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:49.594313 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:49.594780 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:49.719551 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:49.727400 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ff2b52a0-a63c-483c-a70d-e15728828c4f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1578 microversion: 2.1 time: 0.144551 May 11 21:10:49.727965 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 396/797] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:49 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1578 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:49.735434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:49.736038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:49.742098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:49.742549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:49.743312 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:49.743751 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:49.870713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:49.878470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:49.879964 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:49.881104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a9814622-ecaa-402e-89f0-cb3dac9506d0 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.149153 May 11 21:10:49.881686 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 397/798] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:49 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:10:50.731390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:50.731390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:50.731390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:50.731390 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:50.733698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:50.733698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:50.733698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:50.734668 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-48bfc0b5-fa06-48b9-914e-b732d9873e4d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1507 microversion: 2.1 time: 0.155559 May 11 21:10:50.734668 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 398/799] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:50 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:50.745157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:50.745827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:50.751732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:50.752161 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:50.752922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:50.753350 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:50.881470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:50.889015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-80ff45d8-ad54-423f-a1e5-73bebcda3971 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1578 microversion: 2.1 time: 0.148779 May 11 21:10:50.889696 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 399/800] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:50 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:50.899433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:50.900516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:50.906298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:50.906740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:50.907497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:50.907925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:51.042621 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:51.059821 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:51.063521 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:51.064785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b16bd744-e54e-43ca-840a-27d275501149 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.170169 May 11 21:10:51.065656 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 400/801] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:50 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:51.291976 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-84bc3559-beb5-4ba1-8a36-378efa017ef5 req-3a35090d-ce72-419e-be3d-925bcb7003e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f00c24-95f0-4551-990e-c18813091765", "name": "network-vif-plugged", "status": "completed", "tag": "f03f2724-557a-44bf-a2f6-34c8f1d25081"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:51.300576 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-84bc3559-beb5-4ba1-8a36-378efa017ef5 req-3a35090d-ce72-419e-be3d-925bcb7003e5 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:51.301103 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-84bc3559-beb5-4ba1-8a36-378efa017ef5 req-3a35090d-ce72-419e-be3d-925bcb7003e5 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:51.312994 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-84bc3559-beb5-4ba1-8a36-378efa017ef5 req-3a35090d-ce72-419e-be3d-925bcb7003e5 service nova] Creating event network-vif-plugged:f03f2724-557a-44bf-a2f6-34c8f1d25081 for instance b2f00c24-95f0-4551-990e-c18813091765 on hv-cinder-84146 May 11 21:10:51.319106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-84bc3559-beb5-4ba1-8a36-378efa017ef5 req-3a35090d-ce72-419e-be3d-925bcb7003e5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030917 May 11 21:10:51.320398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 401/802] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:10:51.447163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-87e1cc6f-ba15-4b96-be0d-01881ff1e31c req-23283635-41b2-4954-8ce2-57f05f5df6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b17946c-9b29-4cf0-b62d-4037ebde79b1", "name": "network-vif-deleted", "tag": "054cb2d8-9dcc-48fd-a1bf-bf3aaea65572"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:51.456418 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-87e1cc6f-ba15-4b96-be0d-01881ff1e31c req-23283635-41b2-4954-8ce2-57f05f5df6c9 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:51.456857 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-87e1cc6f-ba15-4b96-be0d-01881ff1e31c req-23283635-41b2-4954-8ce2-57f05f5df6c9 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:51.468624 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-87e1cc6f-ba15-4b96-be0d-01881ff1e31c req-23283635-41b2-4954-8ce2-57f05f5df6c9 service nova] Creating event network-vif-deleted:054cb2d8-9dcc-48fd-a1bf-bf3aaea65572 for instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 on hv-cinder-84146 May 11 21:10:51.473631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-87e1cc6f-ba15-4b96-be0d-01881ff1e31c req-23283635-41b2-4954-8ce2-57f05f5df6c9 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031464 May 11 21:10:51.474614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 402/803] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:10:51.478876 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-439cd6c9-ab88-4f6f-9b9b-9f61dec57ba3 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.122166 May 11 21:10:51.492899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 402/804] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:10:48 2022] POST /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments => generated 194 bytes in 3138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:10:51.749654 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:51.750361 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:51.757575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:51.758297 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:51.759402 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:51.760732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:51.832105 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:51.840827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b1cbc176-6aa1-471e-8ac9-2d06ef3c31af tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1293 microversion: 2.1 time: 0.096113 May 11 21:10:51.841821 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 403/805] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:51 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:51.907327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:51.908020 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:51.915705 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:51.916149 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:51.916929 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:51.917364 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:52.003336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:52.011407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-406f631d-4664-417f-b0d2-3803ec177c0d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1511 microversion: 2.1 time: 0.108195 May 11 21:10:52.020916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 403/806] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:51 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1511 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:52.082906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:52.083508 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:52.090840 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:52.091286 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:52.092085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:52.092515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:52.224512 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:52.232356 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:52.233959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:52.235115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1583ac1c-d180-4e9a-a72e-9d28d738b293 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.156153 May 11 21:10:52.235742 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 404/807] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:52 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:52.857504 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:52.858827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:52.872523 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:52.873408 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:52.874415 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:52.875020 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:52.909576 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:52.910336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:52.910787 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lazy-loading 'fault' on Instance uuid 8b17946c-9b29-4cf0-b62d-4037ebde79b1 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:10:52.956707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:52.966353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-68caa028-5ce9-472e-93a6-a1ea6917556e tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 200 len: 1312 microversion: 2.1 time: 0.112817 May 11 21:10:52.967391 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 404/808] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:52 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:53.028674 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:53.032654 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:53.036420 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:53.036829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:53.037632 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:53.038106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:53.123031 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:53.129740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4f8880ee-091e-4072-bb3b-0ef0c4e15fa6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1225 microversion: 2.1 time: 0.105324 May 11 21:10:53.141484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 405/809] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:53 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:53.253304 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:53.253934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:53.260086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:53.260355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:53.261292 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:53.261889 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:53.393207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:53.401930 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:53.403411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:53.404558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4953c8ae-1c7c-4bba-9239-f6efb354eb6b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.155322 May 11 21:10:53.405112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 405/810] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:53 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:53.506173 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-e390f712-e301-49d8-882e-8fd5a169743e req-73870a3c-d65a-4708-89b5-b683dad08522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3855665-64e1-4b51-9e7b-a46354bde903", "name": "network-vif-deleted", "tag": "e2cb6f2a-c41b-40ff-8244-7d1958f2b07e"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:53.515353 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e390f712-e301-49d8-882e-8fd5a169743e req-73870a3c-d65a-4708-89b5-b683dad08522 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:53.515801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e390f712-e301-49d8-882e-8fd5a169743e req-73870a3c-d65a-4708-89b5-b683dad08522 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:53.527240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-e390f712-e301-49d8-882e-8fd5a169743e req-73870a3c-d65a-4708-89b5-b683dad08522 service nova] Creating event network-vif-deleted:e2cb6f2a-c41b-40ff-8244-7d1958f2b07e for instance b3855665-64e1-4b51-9e7b-a46354bde903 on hv-cinder-84146 May 11 21:10:53.531971 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-e390f712-e301-49d8-882e-8fd5a169743e req-73870a3c-d65a-4708-89b5-b683dad08522 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029457 May 11 21:10:53.532554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 406/811] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:53.983989 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:53.984786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: 8b17946c-9b29-4cf0-b62d-4037ebde79b1] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:53.991892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:53.992344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:53.993230 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:53.993772 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.007957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] HTTP exception thrown: Instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 could not be found. May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Request method failure captured: May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 HTTP/1.1 May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCU-pZ8tTrn9OY2Wc4uDkMAlSJqVCr0KLJNOPdapQhLJnNgi_BS7FnKDFSmdGsxSkqXTmNbCv3QEP91gQC6euwQlfmKwCri1evt8cU_1IjIFdX0DbxC6AzKqf9D-w1wqg2naT3dlzBmznTHUWI1p14O6BzSFn-_y1NdwMhiZ9fKOshk May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:10:54.009632 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/838ec035db164e50bc335d2cf141d943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_838ec035db164e50bc335d2cf141d943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: df9d6a9b73e64e31b014b5809912bbe8 May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 could not be found. May 11 21:10:54.011335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '8b17946c-9b29-4cf0-b62d-4037ebde79b1'} May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 could not be found. May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:10:54.012360 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 could not be found. May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 could not be found. May 11 21:10:54.013758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:54.015549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Returning 404 to user: Instance 8b17946c-9b29-4cf0-b62d-4037ebde79b1 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:10:54.015549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f128f59d-e105-4472-a2d4-998dd57e04ec tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1" status: 404 len: 111 microversion: 2.1 time: 0.030912 May 11 21:10:54.015549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 406/812] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:53 2022] GET /compute/v2.1/servers/8b17946c-9b29-4cf0-b62d-4037ebde79b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:10:54.021268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:54.021903 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:54.028448 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.028897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.029683 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.030115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.054166 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:10:54.148879 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:54.149399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:54.155550 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.156012 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.156761 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.157201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.189610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.190064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.190517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lazy-loading 'fault' on Instance uuid b3855665-64e1-4b51-9e7b-a46354bde903 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:10:54.232206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:54.240429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3222d15d-5010-4596-897a-6e7d58990b33 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 200 len: 1230 microversion: 2.1 time: 0.095722 May 11 21:10:54.250014 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 407/813] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:54 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:54.374481 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-980700f5-4c32-470f-ad87-7a1bec8b7c7d tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "DELETE /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 204 len: 0 microversion: 2.1 time: 0.357301 May 11 21:10:54.375103 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 407/814] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:10:54 2022] DELETE /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:10:54.383446 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:54.384051 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:54.389924 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.390445 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.391203 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.391637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.424695 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:54.426116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:54.432544 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.433086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.434006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:54.434459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:54.520859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:54.529155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7a5504fe-f5e2-4052-a031-0118ac87c9fa tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.149951 May 11 21:10:54.529751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 408/815] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:54 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:54.566412 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:54.575223 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:54.576934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:54.578256 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2dde68e7-436b-425e-b0a4-2ee6d42c9caa tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.158401 May 11 21:10:54.578865 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 408/816] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:54 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 21:10:55.258062 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:55.258580 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:55.264954 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.265401 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.266187 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.266615 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.280403 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] HTTP exception thrown: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Request method failure captured: May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 HTTP/1.1 May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCWOVqkkcjXaSDlNIvvy8GEGAk65PbYcbcJUYu8Apba3Lbf8WeYkLIvNz3G4QbJnqXYMXlqOxbzcjuVAnMMBUuhbBlWGzIxfCocQSjjSXKyVpgW6i1i2zNkgVL8xBeH9rtkZ7rVroHn1-mY66gSDGCkpP1BTNhXFu2U3po4qJi8-hnI May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:10:55.282015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-104785076 May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-104785076-project May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 3a47bfbd0a2e459cabaa30d74f45811a May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-104785076-project May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:10:55.283685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'b3855665-64e1-4b51-9e7b-a46354bde903'} May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:10:55.284593 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:10:55.286102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:10:55.287400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Returning 404 to user: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:10:55.287400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-db61e751-f0d9-41cc-83bd-f504072afee6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 404 len: 111 microversion: 2.1 time: 0.029756 May 11 21:10:55.287400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 409/817] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:55 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:10:55.429893 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-805509166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320302024", "security_groups": [{"name": "tempest-secgroup-smoke-644581309"}], "block_device_mapping_v2": [{"uuid": "1298740b-340e-4057-9a56-c005f9b5ec9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8d33d52-b2cd-4098-87c1-78268014f2dc"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:55.536471 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] validate_networks() for [('c8d33d52-b2cd-4098-87c1-78268014f2dc', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:10:55.546226 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:55.547090 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:55.553311 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.554329 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.555205 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.555695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.684542 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:55.691779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-83b24bf2-a387-4b43-9b90-c3a854a30c39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.149536 May 11 21:10:55.692347 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 410/818] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:55 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:55.696899 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:55.697495 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:55.705388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.705908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.706805 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.707341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.842225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:55.853165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:55.854693 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:55.855868 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4c02fa6f-6d21-4cbb-8cca-3f22c31d27b1 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.162545 May 11 21:10:55.856422 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 411/819] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:55 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:55.899388 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:10:55.899803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:10:55.900527 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:10:55.900925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:10:55.901327 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:10:55.909910 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.910349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.911136 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:55.911566 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:55.927626 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:10:55.932011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for user 3a47bfbd0a2e459cabaa30d74f45811a and project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:10:55.985438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:10:55.988133 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1298740b-340e-4057-9a56-c005f9b5ec9d',volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:10:56.553664 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0242d19d-18d1-402b-a320-1275e79a6f5e tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.127975 May 11 21:10:56.554432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 409/820] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:10:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:10:56.564633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7773d16-6219-4c3c-9dcb-b81de000a94b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:56.565245 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b7773d16-6219-4c3c-9dcb-b81de000a94b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:56.617741 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b7773d16-6219-4c3c-9dcb-b81de000a94b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:56.624182 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b7773d16-6219-4c3c-9dcb-b81de000a94b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1094 microversion: 2.1 time: 0.063359 May 11 21:10:56.624754 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 412/821] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:56 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:56.707935 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:56.708545 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:56.714701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:56.715155 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:56.715920 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:56.716353 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:56.849328 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:56.857102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e526811c-3135-42ba-8ba1-9cb5e28c77cc tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.153013 May 11 21:10:56.857698 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 410/822] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:56 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:56.874650 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:56.875254 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:56.881580 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:56.882035 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:56.882795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:56.883229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:57.014099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:57.022549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:57.024678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:57.026155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-aebe261c-dc92-4e3e-bff8-8c89ae407d3b tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1730 microversion: 2.20 time: 0.155304 May 11 21:10:57.026717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 413/823] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:56 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:57.176638 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-35f37699-71be-415c-a8ea-f002ffcfd834 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:57.177129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-35f37699-71be-415c-a8ea-f002ffcfd834 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:57.183011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35f37699-71be-415c-a8ea-f002ffcfd834 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:57.183457 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35f37699-71be-415c-a8ea-f002ffcfd834 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:57.184217 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35f37699-71be-415c-a8ea-f002ffcfd834 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:57.184645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35f37699-71be-415c-a8ea-f002ffcfd834 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:57.207486 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-35f37699-71be-415c-a8ea-f002ffcfd834 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/ips" status: 200 len: 150 microversion: 2.1 time: 0.034614 May 11 21:10:57.208065 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 411/824] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:10:57 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:10:57.640630 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:57.641365 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:57.648318 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:57.648764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:57.649552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:57.649978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:57.725910 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:57.733612 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-867d3470-88a5-4321-94e6-0c6a57960896 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1144 microversion: 2.1 time: 0.097074 May 11 21:10:57.738352 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 414/825] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:57 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:57.875355 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:57.876960 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:57.884406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:57.884959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:57.886294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:57.886977 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:58.022854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:58.032796 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8f3006e0-f6c5-491d-a2eb-e6fa8a39869b tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1521 microversion: 2.1 time: 0.161864 May 11 21:10:58.033377 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 412/826] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:57 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:10:58.044372 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:58.045146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:58.050900 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:58.051347 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:58.053102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:58.053102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:58.215160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-e08227cd-4fae-46ba-a336-2e81b5ffba4a req-c95c4e33-2256-47e5-af22-b236fe5e36e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b", "name": "network-vif-deleted", "tag": "bcd2a37c-3573-4057-b264-754141dbb9d2"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:58.225381 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e08227cd-4fae-46ba-a336-2e81b5ffba4a req-c95c4e33-2256-47e5-af22-b236fe5e36e7 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:58.226598 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e08227cd-4fae-46ba-a336-2e81b5ffba4a req-c95c4e33-2256-47e5-af22-b236fe5e36e7 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:58.238859 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-e08227cd-4fae-46ba-a336-2e81b5ffba4a req-c95c4e33-2256-47e5-af22-b236fe5e36e7 service nova] Creating event network-vif-deleted:bcd2a37c-3573-4057-b264-754141dbb9d2 for instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b on hv-cinder-84146 May 11 21:10:58.244893 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-e08227cd-4fae-46ba-a336-2e81b5ffba4a req-c95c4e33-2256-47e5-af22-b236fe5e36e7 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035286 May 11 21:10:58.246023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 413/827] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:10:58.266231 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:58.273684 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:58.275448 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:58.276698 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f11d9698-b68c-4745-bba3-758dfd121d53 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1717 microversion: 2.20 time: 0.236113 May 11 21:10:58.277322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 415/828] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:10:58 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1717 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:10:58.751358 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:58.751969 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:58.758457 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:58.758900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:58.759651 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:58.760081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:58.822268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:58.829477 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2816a837-b714-4946-953d-052d82122f04 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1192 microversion: 2.1 time: 0.082407 May 11 21:10:58.830071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 414/829] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:58 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:59.049871 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:59.050651 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:59.061064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:59.061975 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:59.063100 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:59.063962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:59.100194 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:59.100650 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:59.101116 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lazy-loading 'fault' on Instance uuid a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:10:59.139139 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-171a9da7-c32c-4acd-b44f-31aa7bb9120e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87bc8e48-d5b4-42fd-ba4a-7b5b6e0e5447"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:10:59.140189 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-171a9da7-c32c-4acd-b44f-31aa7bb9120e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:59.147999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-171a9da7-c32c-4acd-b44f-31aa7bb9120e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:59.148146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df9d6a9b73e64e31b014b5809912bbe8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838ec035db164e50bc335d2cf141d943', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:59.148263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-171a9da7-c32c-4acd-b44f-31aa7bb9120e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:59.148263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-171a9da7-c32c-4acd-b44f-31aa7bb9120e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:59.148263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-171a9da7-c32c-4acd-b44f-31aa7bb9120e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:59.154633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f9f81d1e-b0d3-4760-a9b8-3cb9e5a56a39 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 200 len: 1312 microversion: 2.1 time: 0.108749 May 11 21:10:59.155202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 416/830] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:59 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:10:59.847180 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:10:59.848025 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:10:59.860543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:59.860543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:59.860543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:10:59.860543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:10:59.926811 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:10:59.934812 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-22660a2b-0eac-436a-8e02-4b26f1afaeef tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1210 microversion: 2.1 time: 0.091899 May 11 21:10:59.935677 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 417/831] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:10:59 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:11:00.134112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cfd86c1c-d83f-474e-8f90-02febde66b03 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:00.135111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cfd86c1c-d83f-474e-8f90-02febde66b03 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:00.141446 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd86c1c-d83f-474e-8f90-02febde66b03 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.141931 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd86c1c-d83f-474e-8f90-02febde66b03 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:00.142742 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd86c1c-d83f-474e-8f90-02febde66b03 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.143176 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cfd86c1c-d83f-474e-8f90-02febde66b03 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:00.172609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cfd86c1c-d83f-474e-8f90-02febde66b03 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 May 11 21:11:00.173070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 418/832] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:00 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:11:00.177336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:00.178175 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] [instance: a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:00.183984 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.190535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:00.190535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.190535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:00.199457 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] HTTP exception thrown: Instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b could not be found. May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Request method failure captured: May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b HTTP/1.1 May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCU-pZ8tTrn9OY2Wc4uDkMAlSJqVCr0KLJNOPdapQhLJnNgi_BS7FnKDFSmdGsxSkqXTmNbCv3QEP91gQC6euwQlfmKwCri1evt8cU_1IjIFdX0DbxC6AzKqf9D-w1wqg2naT3dlzBmznTHUWI1p14O6BzSFn-_y1NdwMhiZ9fKOshk May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:00.201046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/838ec035db164e50bc335d2cf141d943"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_838ec035db164e50bc335d2cf141d943"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/838ec035db164e50bc335d2cf141d943"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 838ec035db164e50bc335d2cf141d943 May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-105130898 May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: df9d6a9b73e64e31b014b5809912bbe8 May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-ServerRescueNegativeTestJSON-105130898-project May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b could not be found. May 11 21:11:00.202777 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b'} May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b could not be found. May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:00.203564 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b could not be found. May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b could not be found. May 11 21:11:00.204785 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:00.205890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] Returning 404 to user: Instance a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:00.205890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b7cf7abd-3255-4566-a88c-c162ad1f4da8 tempest-ServerRescueNegativeTestJSON-105130898 tempest-ServerRescueNegativeTestJSON-105130898-project] 10.222.0.35 "GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b" status: 404 len: 111 microversion: 2.1 time: 0.028473 May 11 21:11:00.205890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 419/833] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:00 2022] GET /compute/v2.1/servers/a9ea5eb4-98ef-4b7a-a15a-ebf2f099514b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:00.216492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4bd10f09-b809-4128-91a2-24a9c7d1fbe2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:00.217220 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4bd10f09-b809-4128-91a2-24a9c7d1fbe2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:00.223357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-b809-4128-91a2-24a9c7d1fbe2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.223815 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-b809-4128-91a2-24a9c7d1fbe2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:00.224643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-b809-4128-91a2-24a9c7d1fbe2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.225111 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-b809-4128-91a2-24a9c7d1fbe2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:00.271487 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4bd10f09-b809-4128-91a2-24a9c7d1fbe2 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/954b9c15-cff9-4576-be7b-a3b567e31688" status: 200 len: 194 microversion: 2.1 time: 0.067423 May 11 21:11:00.272499 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 420/834] 10.222.0.35 () {58 vars in 1412 bytes} [Wed May 11 21:11:00 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/954b9c15-cff9-4576-be7b-a3b567e31688 => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:00.272827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-171a9da7-c32c-4acd-b44f-31aa7bb9120e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "POST /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.137591 May 11 21:11:00.274100 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 415/835] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:10:59 2022] POST /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:11:00.961880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:00.962837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:00.980522 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.986368 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:00.988230 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:00.988230 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:01.254025 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:01.262447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-349c89c8-4d3a-458b-adbd-04a808804b61 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1277 microversion: 2.1 time: 0.306839 May 11 21:11:01.263375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 421/836] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:00 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1277 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:01.401905 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-e84bfbe4-ddbe-4e2c-82eb-9062fa9cd44f req-9c579be8-1952-43c8-80af-d8476452ed4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53feae8-565c-4c97-999c-e6ad67000e66", "tag": "cbd65633-32de-4901-ad79-fb11a88761c8"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:01.432001 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e84bfbe4-ddbe-4e2c-82eb-9062fa9cd44f req-9c579be8-1952-43c8-80af-d8476452ed4d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:01.432746 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-e84bfbe4-ddbe-4e2c-82eb-9062fa9cd44f req-9c579be8-1952-43c8-80af-d8476452ed4d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:01.446730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-e84bfbe4-ddbe-4e2c-82eb-9062fa9cd44f req-9c579be8-1952-43c8-80af-d8476452ed4d service nova] Creating event network-changed:cbd65633-32de-4901-ad79-fb11a88761c8 for instance e53feae8-565c-4c97-999c-e6ad67000e66 on hv-cinder-84146 May 11 21:11:01.452483 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-e84bfbe4-ddbe-4e2c-82eb-9062fa9cd44f req-9c579be8-1952-43c8-80af-d8476452ed4d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069847 May 11 21:11:01.453354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 416/837] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:02.025836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d033ad69-e412-43d6-ac29-b2e01216cf74 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c504994b-0e15-4ee3-ac0f-f1ec59273b7e"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:02.027622 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d033ad69-e412-43d6-ac29-b2e01216cf74 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:02.033771 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d033ad69-e412-43d6-ac29-b2e01216cf74 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:02.034207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d033ad69-e412-43d6-ac29-b2e01216cf74 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:02.035351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d033ad69-e412-43d6-ac29-b2e01216cf74 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:02.035942 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d033ad69-e412-43d6-ac29-b2e01216cf74 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:02.280891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:02.281829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:02.289325 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:02.290073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:02.291186 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:02.291626 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:02.500865 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:02.514729 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-44f6e94f-543d-40d1-9861-5211faeb3687 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.238116 May 11 21:11:02.515707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 417/838] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:02 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:11:02.909847 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d033ad69-e412-43d6-ac29-b2e01216cf74 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "POST /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.888422 May 11 21:11:02.916037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 422/839] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:11:02 2022] POST /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:03.531999 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:03.532607 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:03.539119 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:03.540073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:03.540837 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:03.541278 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:03.739410 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:03.747306 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-31829e1c-37fa-4366-8797-cfb07021d49f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.219090 May 11 21:11:03.754510 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 418/840] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:03 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:04.764498 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:04.765196 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:04.771821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:04.772274 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:04.773062 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:04.773722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:04.910155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:04.918478 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7342eac5-0373-400f-869c-7739d91d44e4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.158225 May 11 21:11:04.919243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 423/841] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:04 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:05.935125 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:05.935768 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:05.942006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:05.943848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:05.943848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:05.943848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:06.072456 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:06.079902 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-15f0bf80-65b2-4a67-bb26-599b58aa7b75 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.148633 May 11 21:11:06.080470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 419/842] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:05 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:06.543262 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-647dd2d9-3ff5-4cc8-afa3-6a909a4737ef tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Action: 'create', calling method: .version_select at 0x7ff8980f84c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1214346036", "metadata": {"Type": "work"}}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-647dd2d9-3ff5-4cc8-afa3-6a909a4737ef tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Request method failure captured: May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 122 May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCZqKQVLP4AivVS-4BkA-6Yvxwh6S06j2oW-fbHu9VFyLNAgJgz7cQn4grqQzYTrjodVqQAPn2C2Kbht-8LqE4tGEuB622JgGKyHy7VlHuhYe4mpb1f7tHpGKvfbf-CkoGAW1VmvHiixb6W3dicrsnvwO5T8gfcuM6yQmQ300IOBNsY May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:06.555859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: ab9fadbb88814433bff84bc3b71f761c May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1214346036", "metadata": {"Type": "work"}}} May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: May 11 21:11:06.557417 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1214346036', 'metadata': {'Type': 'work'}}}} May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise error May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi '#$%' May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:06.558449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 21:11:06.560097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 21:11:06.561556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 21:11:06.561556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.561556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-647dd2d9-3ff5-4cc8-afa3-6a909a4737ef tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:06.561556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-647dd2d9-3ff5-4cc8-afa3-6a909a4737ef tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123954 May 11 21:11:06.561556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 424/843] 10.222.0.35 () {60 vars in 1155 bytes} [Wed May 11 21:11:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 21:11:06.566968 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5306b771-6677-4fd8-82f4-9ed3991c82fb tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Action: 'create', calling method: .version_select at 0x7ff89c302af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-490034292", "metadata": {"Type": "work"}}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5306b771-6677-4fd8-82f4-9ed3991c82fb tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Request method failure captured: May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 119 May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCZqKQVLP4AivVS-4BkA-6Yvxwh6S06j2oW-fbHu9VFyLNAgJgz7cQn4grqQzYTrjodVqQAPn2C2Kbht-8LqE4tGEuB622JgGKyHy7VlHuhYe4mpb1f7tHpGKvfbf-CkoGAW1VmvHiixb6W3dicrsnvwO5T8gfcuM6yQmQ300IOBNsY May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:06.570851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: ab9fadbb88814433bff84bc3b71f761c May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-490034292", "metadata": {"Type": "work"}}} May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:11:06.572413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-490034292', 'metadata': {'Type': 'work'}}}} May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise error May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi '0' May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:06.573394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 21:11:06.575029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 21:11:06.576331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 21:11:06.576331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.576331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5306b771-6677-4fd8-82f4-9ed3991c82fb tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:06.576331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5306b771-6677-4fd8-82f4-9ed3991c82fb tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009058 May 11 21:11:06.576331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 420/844] 10.222.0.35 () {60 vars in 1155 bytes} [Wed May 11 21:11:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 21:11:06.580993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b198873a-4415-4878-9428-5c141bfa12f1 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Action: 'create', calling method: .version_select at 0x7ff8990b4280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1939930759", "metadata": {"Type": "work"}}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b198873a-4415-4878-9428-5c141bfa12f1 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Request method failure captured: May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 119 May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCZqKQVLP4AivVS-4BkA-6Yvxwh6S06j2oW-fbHu9VFyLNAgJgz7cQn4grqQzYTrjodVqQAPn2C2Kbht-8LqE4tGEuB622JgGKyHy7VlHuhYe4mpb1f7tHpGKvfbf-CkoGAW1VmvHiixb6W3dicrsnvwO5T8gfcuM6yQmQ300IOBNsY May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:06.583277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: ab9fadbb88814433bff84bc3b71f761c May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1939930759", "metadata": {"Type": "work"}}} May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: May 11 21:11:06.584819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1939930759', 'metadata': {'Type': 'work'}}}} May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise error May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi '' May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:06.585830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 21:11:06.587465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 21:11:06.588914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 21:11:06.588914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.588914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b198873a-4415-4878-9428-5c141bfa12f1 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:06.588914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b198873a-4415-4878-9428-5c141bfa12f1 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007340 May 11 21:11:06.588914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 425/845] 10.222.0.35 () {60 vars in 1155 bytes} [Wed May 11 21:11:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 21:11:06.593602 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-527c2e11-3e7c-4768-9f2a-15845911a168 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Calling method '.version_select at 0x7ff89c2afc10>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:06.620260 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-527c2e11-3e7c-4768-9f2a-15845911a168 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] HTTP exception thrown: Volume tempest-invalid-1962504164 could not be found. May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-527c2e11-3e7c-4768-9f2a-15845911a168 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Request method failure captured: May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1962504164 HTTP/1.1 May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCZqKQVLP4AivVS-4BkA-6Yvxwh6S06j2oW-fbHu9VFyLNAgJgz7cQn4grqQzYTrjodVqQAPn2C2Kbht-8LqE4tGEuB622JgGKyHy7VlHuhYe4mpb1f7tHpGKvfbf-CkoGAW1VmvHiixb6W3dicrsnvwO5T8gfcuM6yQmQ300IOBNsY May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:06.622932 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: ab9fadbb88814433bff84bc3b71f761c May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Volume tempest-invalid-1962504164 could not be found. May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'tempest-invalid-1962504164'} May 11 21:11:06.624811 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1962504164 could not be found. (HTTP 404) (Request-ID: req-b21e1192-06f5-4379-b824-d920eea3156a) May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.625675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 21:11:06.627193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1962504164 could not be found. May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:06.628480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1962504164 could not be found. May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1962504164 could not be found. May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-527c2e11-3e7c-4768-9f2a-15845911a168 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Returning 404 to user: Volume tempest-invalid-1962504164 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-527c2e11-3e7c-4768-9f2a-15845911a168 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1962504164" status: 404 len: 99 microversion: 2.1 time: 0.034312 May 11 21:11:06.629978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 421/846] 10.222.0.35 () {58 vars in 1217 bytes} [Wed May 11 21:11:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1962504164 => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 11 21:11:06.634942 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c99a3a4c-243a-4ffb-9216-b557a9a7b596 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004243 May 11 21:11:06.635434 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 426/847] 10.222.0.35 () {58 vars in 1139 bytes} [Wed May 11 21:11:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 21:11:06.643586 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b94cd302-4740-48b1-83f0-7cef096d258c tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003714 May 11 21:11:06.644089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 422/848] 10.222.0.35 () {58 vars in 1136 bytes} [Wed May 11 21:11:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 21:11:06.653423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f6065eb7-3217-4f3d-a661-e26961fa8c80 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Calling method '.version_select at 0x7ff898081b80>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:06.683450 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-f6065eb7-3217-4f3d-a661-e26961fa8c80 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] HTTP exception thrown: Volume 91c93c96-7d45-4389-9374-322382236643 could not be found. May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f6065eb7-3217-4f3d-a661-e26961fa8c80 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Request method failure captured: May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: DELETE /compute/v2.1/os-volumes/91c93c96-7d45-4389-9374-322382236643 HTTP/1.1 May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCZqKQVLP4AivVS-4BkA-6Yvxwh6S06j2oW-fbHu9VFyLNAgJgz7cQn4grqQzYTrjodVqQAPn2C2Kbht-8LqE4tGEuB622JgGKyHy7VlHuhYe4mpb1f7tHpGKvfbf-CkoGAW1VmvHiixb6W3dicrsnvwO5T8gfcuM6yQmQ300IOBNsY May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:06.686729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: ab9fadbb88814433bff84bc3b71f761c May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Volume 91c93c96-7d45-4389-9374-322382236643 could not be found. May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '91c93c96-7d45-4389-9374-322382236643'} May 11 21:11:06.688300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91c93c96-7d45-4389-9374-322382236643 could not be found. (HTTP 404) (Request-ID: req-c20b2f2c-249b-4ced-95c1-0ccac8d3bf30) May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.689188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 21:11:06.690355 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91c93c96-7d45-4389-9374-322382236643 could not be found. May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 21:11:06.691491 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91c93c96-7d45-4389-9374-322382236643 could not be found. May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91c93c96-7d45-4389-9374-322382236643 could not be found. May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f6065eb7-3217-4f3d-a661-e26961fa8c80 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Returning 404 to user: Volume 91c93c96-7d45-4389-9374-322382236643 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f6065eb7-3217-4f3d-a661-e26961fa8c80 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/91c93c96-7d45-4389-9374-322382236643" status: 404 len: 109 microversion: 2.1 time: 0.039075 May 11 21:11:06.692882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 427/849] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:11:06 2022] DELETE /compute/v2.1/os-volumes/91c93c96-7d45-4389-9374-322382236643 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:06.698090 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c27ed8e4-37c1-4f0d-bc44-49d972ecd547 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Calling method '.version_select at 0x7ff89c3028b0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:06.723269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-c27ed8e4-37c1-4f0d-bc44-49d972ecd547 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] HTTP exception thrown: Volume 07ca1b28-e58e-42d5-9e89-b30408b5f6ff could not be found. May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c27ed8e4-37c1-4f0d-bc44-49d972ecd547 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Request method failure captured: May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/os-volumes/07ca1b28-e58e-42d5-9e89-b30408b5f6ff HTTP/1.1 May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCZqKQVLP4AivVS-4BkA-6Yvxwh6S06j2oW-fbHu9VFyLNAgJgz7cQn4grqQzYTrjodVqQAPn2C2Kbht-8LqE4tGEuB622JgGKyHy7VlHuhYe4mpb1f7tHpGKvfbf-CkoGAW1VmvHiixb6W3dicrsnvwO5T8gfcuM6yQmQ300IOBNsY May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:06.725175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/9f27d80e36424c4980e061fb911b2b9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 9f27d80e36424c4980e061fb911b2b9f May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesNegativeTest-1048757053 May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: ab9fadbb88814433bff84bc3b71f761c May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesNegativeTest-1048757053-project May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Volume 07ca1b28-e58e-42d5-9e89-b30408b5f6ff could not be found. May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '07ca1b28-e58e-42d5-9e89-b30408b5f6ff'} May 11 21:11:06.726839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07ca1b28-e58e-42d5-9e89-b30408b5f6ff could not be found. (HTTP 404) (Request-ID: req-1098db46-210d-469c-9cee-d40a0112e43a) May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.728058 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:11:06.729509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07ca1b28-e58e-42d5-9e89-b30408b5f6ff could not be found. May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 21:11:06.730992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07ca1b28-e58e-42d5-9e89-b30408b5f6ff could not be found. May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07ca1b28-e58e-42d5-9e89-b30408b5f6ff could not be found. May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c27ed8e4-37c1-4f0d-bc44-49d972ecd547 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] Returning 404 to user: Volume 07ca1b28-e58e-42d5-9e89-b30408b5f6ff could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c27ed8e4-37c1-4f0d-bc44-49d972ecd547 tempest-VolumesNegativeTest-1048757053 tempest-VolumesNegativeTest-1048757053-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/07ca1b28-e58e-42d5-9e89-b30408b5f6ff" status: 404 len: 109 microversion: 2.1 time: 0.032897 May 11 21:11:06.732397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 423/850] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:11:06 2022] GET /compute/v2.1/os-volumes/07ca1b28-e58e-42d5-9e89-b30408b5f6ff => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:07.096044 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:07.096651 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:07.103384 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:07.103872 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:07.105867 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:07.106328 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:07.250857 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:07.259214 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-af77482e-ae94-4f9a-9c1e-184341846ab5 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.166911 May 11 21:11:07.259912 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 428/851] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:07 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:07.895048 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:07.895680 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:07.901783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:07.902230 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:07.903004 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:07.903426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:07.981231 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lazy-loading 'services' on Instance uuid 7674641c-2723-4ec9-84c9-6570d3c5b5de {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:11:08.134891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b07f7f86-4c1c-4bbc-8297-2d8d05950642 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments/87bc8e48-d5b4-42fd-ba4a-7b5b6e0e5447" status: 202 len: 0 microversion: 2.1 time: 0.244522 May 11 21:11:08.135654 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 424/852] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:11:07 2022] DELETE /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments/87bc8e48-d5b4-42fd-ba4a-7b5b6e0e5447 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:11:08.143872 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-499c62a4-6b4c-478a-8f50-6aa8b5c6b18b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:08.145164 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-499c62a4-6b4c-478a-8f50-6aa8b5c6b18b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:08.152003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-499c62a4-6b4c-478a-8f50-6aa8b5c6b18b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:08.152449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-499c62a4-6b4c-478a-8f50-6aa8b5c6b18b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:08.153220 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-499c62a4-6b4c-478a-8f50-6aa8b5c6b18b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:08.153688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-499c62a4-6b4c-478a-8f50-6aa8b5c6b18b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:08.183943 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-499c62a4-6b4c-478a-8f50-6aa8b5c6b18b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 May 11 21:11:08.184813 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 429/853] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:08 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:08.282461 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:08.284866 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:08.290730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:08.291479 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:08.292614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:08.293118 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:08.433736 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:08.445686 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f99c6769-7e37-4c6e-acd6-9f18560af2cd tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.163026 May 11 21:11:08.445686 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 425/854] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:08 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:09.195667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-07634638-fa27-4b57-9211-fa2470b4d481 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:09.196753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-07634638-fa27-4b57-9211-fa2470b4d481 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:09.203049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07634638-fa27-4b57-9211-fa2470b4d481 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:09.203726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07634638-fa27-4b57-9211-fa2470b4d481 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:09.204496 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07634638-fa27-4b57-9211-fa2470b4d481 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:09.204917 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07634638-fa27-4b57-9211-fa2470b4d481 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:09.234150 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-07634638-fa27-4b57-9211-fa2470b4d481 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 May 11 21:11:09.234716 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 430/855] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:09 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:09.458282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:09.459013 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:09.465332 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:09.465891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:09.466646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:09.467081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:09.601228 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:09.608498 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cfde4699-d181-47ee-8ce7-8a4d12884714 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.154163 May 11 21:11:09.609071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 426/856] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:09 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:10.246745 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-abdcd8aa-584b-472c-a609-c664111ff7be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:10.247654 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-abdcd8aa-584b-472c-a609-c664111ff7be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:10.254032 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-abdcd8aa-584b-472c-a609-c664111ff7be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:10.254586 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-abdcd8aa-584b-472c-a609-c664111ff7be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:10.255342 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-abdcd8aa-584b-472c-a609-c664111ff7be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:10.255770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-abdcd8aa-584b-472c-a609-c664111ff7be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:10.284534 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-abdcd8aa-584b-472c-a609-c664111ff7be tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 May 11 21:11:10.285077 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 431/857] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:10 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:10.624958 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:10.625490 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:10.632245 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:10.632696 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:10.633446 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:10.633896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:10.758346 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:10.765591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4dce7ea5-7607-462c-ba92-8f20caf3f73c tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.144502 May 11 21:11:10.766158 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 427/858] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:10 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:11.296186 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-00e96b92-9ba8-4a6b-9e2b-dd4f2e51f691 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:11.297898 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-00e96b92-9ba8-4a6b-9e2b-dd4f2e51f691 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:11.305388 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-0216b74e-487f-43fc-a53c-544b44dce118 req-cec3ef0c-3805-428e-b25b-bc1b1ae55765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53feae8-565c-4c97-999c-e6ad67000e66", "name": "network-vif-plugged", "status": "completed", "tag": "cbd65633-32de-4901-ad79-fb11a88761c8"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:11.310910 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-00e96b92-9ba8-4a6b-9e2b-dd4f2e51f691 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:11.311805 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-00e96b92-9ba8-4a6b-9e2b-dd4f2e51f691 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:11.312064 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-00e96b92-9ba8-4a6b-9e2b-dd4f2e51f691 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:11.312498 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-00e96b92-9ba8-4a6b-9e2b-dd4f2e51f691 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:11.313476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0216b74e-487f-43fc-a53c-544b44dce118 req-cec3ef0c-3805-428e-b25b-bc1b1ae55765 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:11.313958 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-0216b74e-487f-43fc-a53c-544b44dce118 req-cec3ef0c-3805-428e-b25b-bc1b1ae55765 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:11.328004 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-0216b74e-487f-43fc-a53c-544b44dce118 req-cec3ef0c-3805-428e-b25b-bc1b1ae55765 service nova] Creating event network-vif-plugged:cbd65633-32de-4901-ad79-fb11a88761c8 for instance e53feae8-565c-4c97-999c-e6ad67000e66 on hv-cinder-84146 May 11 21:11:11.333050 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-0216b74e-487f-43fc-a53c-544b44dce118 req-cec3ef0c-3805-428e-b25b-bc1b1ae55765 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 May 11 21:11:11.334042 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 428/859] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:11.343312 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-00e96b92-9ba8-4a6b-9e2b-dd4f2e51f691 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051046 May 11 21:11:11.344090 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 432/860] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:11 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:11.783324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:11.784014 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:11.790775 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:11.791219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:11.791983 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:11.795554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:11.925697 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:11.932937 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-24fd3a31-2c2e-412e-bda8-640903978636 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.154274 May 11 21:11:11.933506 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 429/861] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:11 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:12.355243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1278a8b2-931c-46cb-a65c-42c56b7398f6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:12.356191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1278a8b2-931c-46cb-a65c-42c56b7398f6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:12.362352 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1278a8b2-931c-46cb-a65c-42c56b7398f6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:12.362792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1278a8b2-931c-46cb-a65c-42c56b7398f6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:12.363582 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1278a8b2-931c-46cb-a65c-42c56b7398f6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:12.364018 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1278a8b2-931c-46cb-a65c-42c56b7398f6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:12.392243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1278a8b2-931c-46cb-a65c-42c56b7398f6 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 May 11 21:11:12.392784 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 433/862] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:12 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:12.949849 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:12.950460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:12.956672 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:12.957120 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:12.957913 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:12.958349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:13.088637 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:13.096121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e09b612f-8285-4db0-8a60-bab73d351a4b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1265 microversion: 2.1 time: 0.150185 May 11 21:11:13.096623 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 430/863] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:12 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:13.403879 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0b60a93d-1729-45f0-9e3f-48f7a1f062d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:13.404701 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0b60a93d-1729-45f0-9e3f-48f7a1f062d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:13.410841 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b60a93d-1729-45f0-9e3f-48f7a1f062d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:13.411287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b60a93d-1729-45f0-9e3f-48f7a1f062d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:13.412045 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b60a93d-1729-45f0-9e3f-48f7a1f062d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:13.412476 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0b60a93d-1729-45f0-9e3f-48f7a1f062d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:13.440354 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0b60a93d-1729-45f0-9e3f-48f7a1f062d8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040772 May 11 21:11:13.440895 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 434/864] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:13 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:14.112181 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:14.112783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:14.119079 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:14.119521 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:14.120311 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:14.120768 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:14.246238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:14.253367 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8aaf9be4-ce3b-479b-aabc-27e7c3dd9607 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1453 microversion: 2.1 time: 0.145125 May 11 21:11:14.253959 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 431/865] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:14 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:14.269462 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:14.270094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:14.276028 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:14.276469 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:14.277250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:14.277708 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:14.403395 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:14.411055 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-07e85203-d8b7-4e00-8766-2707897c51c8 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1453 microversion: 2.1 time: 0.145383 May 11 21:11:14.411614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 435/866] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:14 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:14.452102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5d2a5af8-9f23-463d-a4c3-5fd85f1a2fde tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:14.453220 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5d2a5af8-9f23-463d-a4c3-5fd85f1a2fde tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:14.459118 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d2a5af8-9f23-463d-a4c3-5fd85f1a2fde tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:14.459570 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d2a5af8-9f23-463d-a4c3-5fd85f1a2fde tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:14.460347 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d2a5af8-9f23-463d-a4c3-5fd85f1a2fde tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:14.460783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5d2a5af8-9f23-463d-a4c3-5fd85f1a2fde tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:14.490410 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5d2a5af8-9f23-463d-a4c3-5fd85f1a2fde tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042277 May 11 21:11:14.496215 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 432/867] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:14 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:15.505904 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e9fb5a5c-4c00-409d-b3fd-9d4c3700351b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:15.507915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e9fb5a5c-4c00-409d-b3fd-9d4c3700351b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:15.514097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e9fb5a5c-4c00-409d-b3fd-9d4c3700351b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:15.514538 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e9fb5a5c-4c00-409d-b3fd-9d4c3700351b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:15.515294 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e9fb5a5c-4c00-409d-b3fd-9d4c3700351b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:15.515722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e9fb5a5c-4c00-409d-b3fd-9d4c3700351b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:15.545859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e9fb5a5c-4c00-409d-b3fd-9d4c3700351b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 May 11 21:11:15.546433 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 436/868] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:15 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:16.557823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ab979d92-3b3e-4a75-932d-b65d48c5abbf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:16.558735 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ab979d92-3b3e-4a75-932d-b65d48c5abbf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:16.565679 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab979d92-3b3e-4a75-932d-b65d48c5abbf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:16.566115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab979d92-3b3e-4a75-932d-b65d48c5abbf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:16.566890 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab979d92-3b3e-4a75-932d-b65d48c5abbf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:16.567315 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab979d92-3b3e-4a75-932d-b65d48c5abbf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:16.599091 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ab979d92-3b3e-4a75-932d-b65d48c5abbf tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 May 11 21:11:16.603503 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 433/869] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:16 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:16.676293 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-fb97d45d-7d55-4c32-b186-f6283632ecbb req-6af06af3-d6ab-4325-b34d-7d6ee6b96bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53feae8-565c-4c97-999c-e6ad67000e66", "tag": "cbd65633-32de-4901-ad79-fb11a88761c8"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:16.684670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fb97d45d-7d55-4c32-b186-f6283632ecbb req-6af06af3-d6ab-4325-b34d-7d6ee6b96bf4 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:16.685110 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fb97d45d-7d55-4c32-b186-f6283632ecbb req-6af06af3-d6ab-4325-b34d-7d6ee6b96bf4 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:16.698224 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-fb97d45d-7d55-4c32-b186-f6283632ecbb req-6af06af3-d6ab-4325-b34d-7d6ee6b96bf4 service nova] Creating event network-changed:cbd65633-32de-4901-ad79-fb11a88761c8 for instance e53feae8-565c-4c97-999c-e6ad67000e66 on hv-cinder-84146 May 11 21:11:16.703436 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-fb97d45d-7d55-4c32-b186-f6283632ecbb req-6af06af3-d6ab-4325-b34d-7d6ee6b96bf4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030777 May 11 21:11:16.704076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 437/870] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:17.613690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-428fcaec-ec11-43a8-9be2-40244666651e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:17.614626 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-428fcaec-ec11-43a8-9be2-40244666651e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:17.622354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-428fcaec-ec11-43a8-9be2-40244666651e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:17.622790 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-428fcaec-ec11-43a8-9be2-40244666651e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:17.623563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-428fcaec-ec11-43a8-9be2-40244666651e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:17.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-428fcaec-ec11-43a8-9be2-40244666651e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:17.658494 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-428fcaec-ec11-43a8-9be2-40244666651e tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047922 May 11 21:11:17.658494 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 434/871] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:17 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:17.829756 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-03f6df47-5636-477c-be66-d2fffd3ad64b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:17.831418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-03f6df47-5636-477c-be66-d2fffd3ad64b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:17.838875 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03f6df47-5636-477c-be66-d2fffd3ad64b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:17.839863 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03f6df47-5636-477c-be66-d2fffd3ad64b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:17.841016 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03f6df47-5636-477c-be66-d2fffd3ad64b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:17.841696 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03f6df47-5636-477c-be66-d2fffd3ad64b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:17.873987 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-03f6df47-5636-477c-be66-d2fffd3ad64b tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049102 May 11 21:11:17.874578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 438/872] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:17 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:18.035919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bedd8015-b2f1-4c8e-aa54-f8e9401680a0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:18.035919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bedd8015-b2f1-4c8e-aa54-f8e9401680a0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:18.035919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bedd8015-b2f1-4c8e-aa54-f8e9401680a0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.035919 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bedd8015-b2f1-4c8e-aa54-f8e9401680a0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.036319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bedd8015-b2f1-4c8e-aa54-f8e9401680a0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.036319 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bedd8015-b2f1-4c8e-aa54-f8e9401680a0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.057243 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bedd8015-b2f1-4c8e-aa54-f8e9401680a0 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/954b9c15-cff9-4576-be7b-a3b567e31688" status: 200 len: 194 microversion: 2.1 time: 0.041294 May 11 21:11:18.057853 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 435/873] 10.222.0.35 () {58 vars in 1412 bytes} [Wed May 11 21:11:18 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/954b9c15-cff9-4576-be7b-a3b567e31688 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:18.067331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:18.067851 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:18.073618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.074061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.074865 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.075293 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.158709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lazy-loading 'services' on Instance uuid d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:11:18.421009 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ffaf862b-6875-4b25-949b-52ffbe34b4ad tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/954b9c15-cff9-4576-be7b-a3b567e31688" status: 202 len: 0 microversion: 2.1 time: 0.349630 May 11 21:11:18.421009 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 439/874] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:11:18 2022] DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/954b9c15-cff9-4576-be7b-a3b567e31688 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:11:18.668771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3d362a2b-bdc5-494e-bbad-e8d7bb87913b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:18.669715 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3d362a2b-bdc5-494e-bbad-e8d7bb87913b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:18.675875 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d362a2b-bdc5-494e-bbad-e8d7bb87913b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.676324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d362a2b-bdc5-494e-bbad-e8d7bb87913b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.677107 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d362a2b-bdc5-494e-bbad-e8d7bb87913b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.677568 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d362a2b-bdc5-494e-bbad-e8d7bb87913b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.707305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3d362a2b-bdc5-494e-bbad-e8d7bb87913b tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042378 May 11 21:11:18.707868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 436/875] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:18 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:11:18.769046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:18.769675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:18.776476 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.776940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.777729 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:18.778183 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:18.803088 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:11:19.071811 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1d7a28f6-555c-4fd9-83b2-09e57cb0513d tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 204 len: 0 microversion: 2.1 time: 0.306555 May 11 21:11:19.072518 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 440/876] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:18 2022] DELETE /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 21:11:19.080382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:19.081021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:19.087384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:19.087826 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:19.088579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:19.089008 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:19.218610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:19.226037 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f34a545a-ffac-4133-9b34-31244153edf2 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1683 microversion: 2.1 time: 0.149430 May 11 21:11:19.226596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 437/877] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:19 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:20.243271 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:20.243972 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:20.250266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:20.250720 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:20.251486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:20.251926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:20.377573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:20.385404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-37962256-b7f3-4bc6-a477-552b18f89d8f tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1683 microversion: 2.1 time: 0.146307 May 11 21:11:20.385960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 441/878] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:20 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:21.404391 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:21.405213 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:21.414715 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:21.415285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:21.416171 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:21.416671 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:21.547669 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:21.555045 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-11de7f32-d59c-41d0-b645-bc6feaae2027 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1683 microversion: 2.1 time: 0.155108 May 11 21:11:21.555677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 438/879] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:21 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:21.639768 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4123c45e-d683-45c4-a651-526ba731d068 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:21.640441 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4123c45e-d683-45c4-a651-526ba731d068 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:21.649170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4123c45e-d683-45c4-a651-526ba731d068 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:21.649728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4123c45e-d683-45c4-a651-526ba731d068 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:21.650517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4123c45e-d683-45c4-a651-526ba731d068 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:21.651384 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4123c45e-d683-45c4-a651-526ba731d068 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:21.683706 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4123c45e-d683-45c4-a651-526ba731d068 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/c504994b-0e15-4ee3-ac0f-f1ec59273b7e" status: 200 len: 194 microversion: 2.1 time: 0.048956 May 11 21:11:21.684599 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 442/880] 10.222.0.35 () {58 vars in 1412 bytes} [Wed May 11 21:11:21 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/c504994b-0e15-4ee3-ac0f-f1ec59273b7e => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:21.694549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:21.695040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:21.701222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:21.701714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:21.702485 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:21.702970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:21.788460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lazy-loading 'services' on Instance uuid d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:11:22.046296 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f5862fe2-d0ff-4df0-be42-810b5b6ad65d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/c504994b-0e15-4ee3-ac0f-f1ec59273b7e" status: 202 len: 0 microversion: 2.1 time: 0.354252 May 11 21:11:22.047550 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 439/881] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:11:21 2022] DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments/c504994b-0e15-4ee3-ac0f-f1ec59273b7e => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 21:11:22.242074 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-0f2a2cf8-bd6d-4593-8a9c-6a40fce656e1 req-c2b18820-f8da-49c5-899a-0570c171fb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7674641c-2723-4ec9-84c9-6570d3c5b5de", "name": "network-vif-deleted", "tag": "a9d8e283-e472-4b3a-9210-66b4191723d1"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:22.250828 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-0f2a2cf8-bd6d-4593-8a9c-6a40fce656e1 req-c2b18820-f8da-49c5-899a-0570c171fb6f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:22.251268 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-0f2a2cf8-bd6d-4593-8a9c-6a40fce656e1 req-c2b18820-f8da-49c5-899a-0570c171fb6f service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:22.262724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-0f2a2cf8-bd6d-4593-8a9c-6a40fce656e1 req-c2b18820-f8da-49c5-899a-0570c171fb6f service nova] Creating event network-vif-deleted:a9d8e283-e472-4b3a-9210-66b4191723d1 for instance 7674641c-2723-4ec9-84c9-6570d3c5b5de on hv-cinder-84146 May 11 21:11:22.267960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-0f2a2cf8-bd6d-4593-8a9c-6a40fce656e1 req-c2b18820-f8da-49c5-899a-0570c171fb6f service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029712 May 11 21:11:22.268561 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 443/882] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:22.572675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:22.573285 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:22.581506 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:22.581980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:22.582866 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:22.583305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:22.680395 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baed8aff24b64c788f40e6d7dd1f99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1ed05b84e545989b4753dab7bd4b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:22.690809 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5e0c9875-62da-4345-947b-79e0fcd9c648 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 200 len: 1327 microversion: 2.1 time: 0.122273 May 11 21:11:22.691847 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 440/883] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:22 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:23.223118 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d89e05b9-cbf6-4079-9333-d7c71a8a5f54 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:23.224121 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d89e05b9-cbf6-4079-9333-d7c71a8a5f54 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:23.230767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89e05b9-cbf6-4079-9333-d7c71a8a5f54 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:23.231217 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89e05b9-cbf6-4079-9333-d7c71a8a5f54 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:23.231993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89e05b9-cbf6-4079-9333-d7c71a8a5f54 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:23.232431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d89e05b9-cbf6-4079-9333-d7c71a8a5f54 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:23.261801 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d89e05b9-cbf6-4079-9333-d7c71a8a5f54 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043091 May 11 21:11:23.262359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 444/884] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:23 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:23.708620 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:23.709339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:23.716472 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:23.716978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:23.717777 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:23.718206 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:23.732591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de HTTP/1.1 May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:23.734149 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:23.735610 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '7674641c-2723-4ec9-84c9-6570d3c5b5de'} May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:23.739834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:23.741553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:23.743534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:23.743534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2fcd46cb-3584-49fc-9b50-b1fb596b5b65 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 404 len: 111 microversion: 2.1 time: 0.031217 May 11 21:11:23.743534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 441/885] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:23 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:23.745047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bdee02b5-c38f-48fa-be89-93de643d5b99 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '.version_select at 0x7ff898081ca0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:23.825279 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bdee02b5-c38f-48fa-be89-93de643d5b99 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127879333" status: 202 len: 0 microversion: 2.1 time: 0.084419 May 11 21:11:23.826188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 445/886] 10.222.0.35 () {58 vars in 1220 bytes} [Wed May 11 21:11:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127879333 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:11:24.274354 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-23d7fbd7-9a39-41c6-b8e8-fd8a43852430 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:24.278419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-23d7fbd7-9a39-41c6-b8e8-fd8a43852430 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:24.281869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23d7fbd7-9a39-41c6-b8e8-fd8a43852430 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.282429 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23d7fbd7-9a39-41c6-b8e8-fd8a43852430 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:24.283271 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23d7fbd7-9a39-41c6-b8e8-fd8a43852430 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.283768 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-23d7fbd7-9a39-41c6-b8e8-fd8a43852430 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:24.312612 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-23d7fbd7-9a39-41c6-b8e8-fd8a43852430 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043072 May 11 21:11:24.313393 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 442/887] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:24 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:11:24.419917 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-707f6e9d-32fc-446c-a999-960ab527ac3f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:24.420818 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-707f6e9d-32fc-446c-a999-960ab527ac3f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:24.428933 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-707f6e9d-32fc-446c-a999-960ab527ac3f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.429412 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-707f6e9d-32fc-446c-a999-960ab527ac3f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:24.430208 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-707f6e9d-32fc-446c-a999-960ab527ac3f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.430637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-707f6e9d-32fc-446c-a999-960ab527ac3f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:24.457987 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-707f6e9d-32fc-446c-a999-960ab527ac3f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042440 May 11 21:11:24.462081 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 446/888] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:11:24 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:11:24.516373 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:24.516864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:24.525443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.525443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:24.525443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.525443 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:24.549428 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:11:24.917305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-183b0d7c-612e-4012-9464-267348f1717d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 204 len: 0 microversion: 2.1 time: 0.404402 May 11 21:11:24.917984 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 443/889] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:24 2022] DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:11:24.928559 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:24.930809 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:24.937108 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.937831 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:24.938800 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:24.939297 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:25.071788 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:25.079187 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e533703b-5e32-4929-9bff-ecdf059d3061 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1674 microversion: 2.1 time: 0.155808 May 11 21:11:25.079836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 447/890] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:24 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:11:25.983002 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:25.983576 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:25.990314 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:25.990757 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:25.991518 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:25.992453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:26.005701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de HTTP/1.1 May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:26.007338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.009501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '7674641c-2723-4ec9-84c9-6570d3c5b5de'} May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:26.010622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.012222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:26.013753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:26.013753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-37f9a754-e8d1-4af5-b895-ca8adc0a7c73 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 404 len: 111 microversion: 2.1 time: 0.030827 May 11 21:11:26.013753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 444/891] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:25 2022] DELETE /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:26.022957 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:26.023639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 7674641c-2723-4ec9-84c9-6570d3c5b5de] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:26.030573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:26.031025 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:26.031796 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:26.032221 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:26.045669 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de HTTP/1.1 May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:26.047276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.048609 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '7674641c-2723-4ec9-84c9-6570d3c5b5de'} May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:26.049503 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. May 11 21:11:26.051153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:26.052525 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 7674641c-2723-4ec9-84c9-6570d3c5b5de could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:26.052525 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-593f67ff-9356-415a-9199-4ce45f0b5cd8 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de" status: 404 len: 111 microversion: 2.1 time: 0.029657 May 11 21:11:26.052525 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 448/892] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:26 2022] GET /compute/v2.1/servers/7674641c-2723-4ec9-84c9-6570d3c5b5de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:26.095937 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:26.096638 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:26.102883 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:26.103379 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:26.104199 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:26.104642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:26.243378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:26.250843 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-30c26f61-d9cd-4911-b2ae-ba62514209e1 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1674 microversion: 2.1 time: 0.158689 May 11 21:11:26.256603 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 445/893] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:26 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:27.270315 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:27.270926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:27.278335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.278994 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.280037 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.283688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.302490 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:27.311239 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:27.311239 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.311239 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.311657 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.311914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.327611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f HTTP/1.1 May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:27.329229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.330946 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '1c477417-2e64-4722-ba8d-e9765385ff3f'} May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:27.331900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.333432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.338323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:27.338323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-aea7a747-21fe-49c3-9395-0e7f8a5eae26 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 404 len: 111 microversion: 2.1 time: 0.032155 May 11 21:11:27.338323 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 446/894] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:27 2022] DELETE /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:27.339822 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:27.340431 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 1c477417-2e64-4722-ba8d-e9765385ff3f] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:27.346214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.346653 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.347408 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.347836 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.361035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f HTTP/1.1 May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:27.365799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.367619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '1c477417-2e64-4722-ba8d-e9765385ff3f'} May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:27.368534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. May 11 21:11:27.369967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.371309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 1c477417-2e64-4722-ba8d-e9765385ff3f could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:27.371309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-db6fabf6-2f55-451c-a027-442b3e784ef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f" status: 404 len: 111 microversion: 2.1 time: 0.028547 May 11 21:11:27.371309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 447/895] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:27 2022] GET /compute/v2.1/servers/1c477417-2e64-4722-ba8d-e9765385ff3f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 21:11:27.372031 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:27.372549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:27.378581 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.378839 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.379622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.380160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.393704 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c HTTP/1.1 May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:27.395242 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.396874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '4d723bfd-a4d6-44d4-8910-f88e2b7b395c'} May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:27.397806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.399870 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.402373 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:27.402373 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ce50e35e-215b-4bbe-bcf5-1286edcfae5c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 404 len: 111 microversion: 2.1 time: 0.028213 May 11 21:11:27.402373 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 448/896] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:27 2022] DELETE /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 21:11:27.405858 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:27.408975 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: 4d723bfd-a4d6-44d4-8910-f88e2b7b395c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:27.412135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.412584 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.413389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.413950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.427114 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c HTTP/1.1 May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:27.428646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.434784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '4d723bfd-a4d6-44d4-8910-f88e2b7b395c'} May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:27.435949 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. May 11 21:11:27.437463 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:27.438967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance 4d723bfd-a4d6-44d4-8910-f88e2b7b395c could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:27.438967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6b8cdbfc-db4b-4d6d-a923-db98f478dde1 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c" status: 404 len: 111 microversion: 2.1 time: 0.027887 May 11 21:11:27.438967 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 449/897] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:27 2022] GET /compute/v2.1/servers/4d723bfd-a4d6-44d4-8910-f88e2b7b395c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 21:11:27.439404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:27.446194 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ce45fe8e-ccf7-4de6-8e2e-24faca6774b5 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1674 microversion: 2.1 time: 0.179698 May 11 21:11:27.446845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 449/898] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:27 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:27.774882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-50c18a96-e20e-4b29-866b-7a27d119d6b0 req-18c25412-c267-49e5-b355-7d38891d9f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60", "name": "network-vif-deleted", "tag": "12f6eed9-d209-452c-9d4a-069e1266f397"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:27.783224 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-50c18a96-e20e-4b29-866b-7a27d119d6b0 req-18c25412-c267-49e5-b355-7d38891d9f81 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:27.791234 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-50c18a96-e20e-4b29-866b-7a27d119d6b0 req-18c25412-c267-49e5-b355-7d38891d9f81 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:27.795496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-50c18a96-e20e-4b29-866b-7a27d119d6b0 req-18c25412-c267-49e5-b355-7d38891d9f81 service nova] Creating event network-vif-deleted:12f6eed9-d209-452c-9d4a-069e1266f397 for instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 on hv-cinder-84146 May 11 21:11:27.800335 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-50c18a96-e20e-4b29-866b-7a27d119d6b0 req-18c25412-c267-49e5-b355-7d38891d9f81 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029539 May 11 21:11:27.800947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 450/899] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:28.463698 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:28.464291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:28.471108 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:28.471683 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:28.472591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:28.473162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:28.522227 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:28.522862 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:28.524299 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lazy-loading 'fault' on Instance uuid d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:11:28.571924 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9968edcee104432ade2014e39683bb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513637db58d34fe198b2de93d2cbbeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:28.579607 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e257e148-4b7a-4ab0-a667-0dd234e2cfb4 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 200 len: 1328 microversion: 2.1 time: 0.120503 May 11 21:11:28.580167 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 450/900] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:28 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:28.693914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:28.697259 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:28.702106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:28.702578 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:28.703541 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:28.703974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:28.719468 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 HTTP/1.1 May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:28.721405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.722894 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b8a0c714-2a75-4c5a-b97c-bd3407687b16'} May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:28.725409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.732897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:28.734263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:28.734263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7a7ce5f5-ac10-4d7c-aa60-668e7385fa1c tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 404 len: 111 microversion: 2.1 time: 0.035347 May 11 21:11:28.734263 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 451/901] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:28 2022] DELETE /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:28.736522 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:28.737366 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] [instance: b8a0c714-2a75-4c5a-b97c-bd3407687b16] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:28.744202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:28.744660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:28.745440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:28.745935 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:28.760367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] HTTP exception thrown: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Request method failure captured: May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 HTTP/1.1 May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCT-1MH7wK91O1bPuvce1gofMCBP9GTQIizdn6fpiKcqBYAw_ONoUbeWq6d1kdRaT9B4leDm_mBvY-1N1IBUOaOiEEtDrFOgovq1AVYpj53yseD1jucVotJAEsnS9HD3ugOJeZ0aFoscXK6tdiGwYYmrMouuhFVQM4Mr9yJfEGRqxic May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:28.761952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ad1ed05b84e545989b4753dab7bd4b3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ad1ed05b84e545989b4753dab7bd4b3f May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1180803238 May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: baed8aff24b64c788f40e6d7dd1f99c3 May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeNegativeTest-1180803238-project May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.763338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'b8a0c714-2a75-4c5a-b97c-bd3407687b16'} May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:28.766071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. May 11 21:11:28.767345 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:28.768425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] Returning 404 to user: Instance b8a0c714-2a75-4c5a-b97c-bd3407687b16 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:28.768425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-434a882c-645e-443b-a726-875080becef4 tempest-AttachVolumeNegativeTest-1180803238 tempest-AttachVolumeNegativeTest-1180803238-project] 10.222.0.35 "GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16" status: 404 len: 111 microversion: 2.1 time: 0.035436 May 11 21:11:28.768425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 451/902] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:28 2022] GET /compute/v2.1/servers/b8a0c714-2a75-4c5a-b97c-bd3407687b16 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:29.596621 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:29.597254 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:29.603592 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:29.604025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:29.604784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:29.605214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:29.618891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] HTTP exception thrown: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Request method failure captured: May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 HTTP/1.1 May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT4gBeOwXwRv25_24TWrP10tt7MS4_EyKFpWEuAogO0rV6ASvHNXAd_l_VqMn9bll-uwO7qAHpNZlA-CVBR1K-G92TJrvAK2KoxLWaEGWZz-FtQPwHkpP4H-XE4yVUoNXqhqMe8_BJ2TuU-SbEWBuYpay4iCTjwlI4tel-RC8a0Uds May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:29.620394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: f9968edcee104432ade2014e39683bb5 May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:29.621901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'd5721a6a-5ce3-4880-9cc4-5bfaec1cbe60'} May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:29.622749 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:29.623996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:29.625116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Returning 404 to user: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:29.625116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4f2a8a5d-f1f5-41a9-9168-aa1ad34320da tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 404 len: 111 microversion: 2.1 time: 0.028966 May 11 21:11:29.625116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 452/903] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:29 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:29.630526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a0f4e8cc-55c3-4566-a28b-ba7c3acbca9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '.version_select at 0x7ff898033280>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:29.700875 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a0f4e8cc-55c3-4566-a28b-ba7c3acbca9f tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557565487" status: 202 len: 0 microversion: 2.1 time: 0.074052 May 11 21:11:29.701452 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 452/904] 10.222.0.35 () {58 vars in 1220 bytes} [Wed May 11 21:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557565487 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:11:31.669404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d69f9cb5-b0ff-40ef-9e09-ec7f16f28396 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:31.670356 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d69f9cb5-b0ff-40ef-9e09-ec7f16f28396 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:31.676927 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d69f9cb5-b0ff-40ef-9e09-ec7f16f28396 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:31.677374 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d69f9cb5-b0ff-40ef-9e09-ec7f16f28396 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:31.678701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d69f9cb5-b0ff-40ef-9e09-ec7f16f28396 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:31.678701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d69f9cb5-b0ff-40ef-9e09-ec7f16f28396 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:31.707736 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d69f9cb5-b0ff-40ef-9e09-ec7f16f28396 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042534 May 11 21:11:31.708487 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 453/905] 10.222.0.35 () {60 vars in 1342 bytes} [Wed May 11 21:11:31 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:31.772549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:31.773767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:31.780810 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:31.781262 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:31.782062 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:31.782676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:31.807727 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:11:32.111091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-96423d6b-da9f-4878-82c5-841b758b8072 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 204 len: 0 microversion: 2.20 time: 0.342932 May 11 21:11:32.111681 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 453/906] 10.222.0.35 () {60 vars in 1279 bytes} [Wed May 11 21:11:31 2022] DELETE /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 21:11:32.120554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:32.121086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:32.126753 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:32.127199 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:32.127957 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:32.128388 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:32.307357 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:32.315159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:32.316682 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:32.317868 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-229dd057-fe63-409c-8493-084b8562c9ff tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.201997 May 11 21:11:32.318421 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 454/907] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:11:32 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:11:33.338512 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:33.339098 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:33.345477 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:33.345954 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:33.346714 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:33.347139 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:33.485624 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:33.494287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:33.495949 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:33.501675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-604f6d0f-0d66-4f7a-bace-ff6fb0f1dc55 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1723 microversion: 2.20 time: 0.163646 May 11 21:11:33.501675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 454/908] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:11:33 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:11:33.768600 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:33.769134 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:33.775375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:33.776086 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:33.776874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:33.777349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:33.791304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] HTTP exception thrown: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Request method failure captured: May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 HTTP/1.1 May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT4gBeOwXwRv25_24TWrP10tt7MS4_EyKFpWEuAogO0rV6ASvHNXAd_l_VqMn9bll-uwO7qAHpNZlA-CVBR1K-G92TJrvAK2KoxLWaEGWZz-FtQPwHkpP4H-XE4yVUoNXqhqMe8_BJ2TuU-SbEWBuYpay4iCTjwlI4tel-RC8a0Uds May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:33.792907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: f9968edcee104432ade2014e39683bb5 May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.794549 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'd5721a6a-5ce3-4880-9cc4-5bfaec1cbe60'} May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:33.795645 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.796891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:33.798294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Returning 404 to user: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:33.798294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6da7ea59-95dc-429e-ada7-b89dc0081b22 tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 404 len: 111 microversion: 2.1 time: 0.029782 May 11 21:11:33.798294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 455/909] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:33 2022] DELETE /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:33.802884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:33.803529 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:33.809949 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:33.810400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:33.811229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:33.811740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:33.825623 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] HTTP exception thrown: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Request method failure captured: May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 HTTP/1.1 May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCT4gBeOwXwRv25_24TWrP10tt7MS4_EyKFpWEuAogO0rV6ASvHNXAd_l_VqMn9bll-uwO7qAHpNZlA-CVBR1K-G92TJrvAK2KoxLWaEGWZz-FtQPwHkpP4H-XE4yVUoNXqhqMe8_BJ2TuU-SbEWBuYpay4iCTjwlI4tel-RC8a0Uds May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:33.827353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: f9968edcee104432ade2014e39683bb5 May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.828916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'd5721a6a-5ce3-4880-9cc4-5bfaec1cbe60'} May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:33.829795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. May 11 21:11:33.831207 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:33.832530 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Returning 404 to user: Instance d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:33.832530 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-221cf9f9-2580-4d88-a5a3-e9ed43197a5e tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60" status: 404 len: 111 microversion: 2.1 time: 0.029747 May 11 21:11:33.832530 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 455/910] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:33 2022] GET /compute/v2.1/servers/d5721a6a-5ce3-4880-9cc4-5bfaec1cbe60 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 21:11:34.516219 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:34.516833 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:34.523805 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:34.524464 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:34.525426 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:34.526316 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:34.612797 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:34.620599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:34.622141 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7666a6299cc4c44ac7495ed00f137dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d75c229dc14e59b53a1ec63a0f00f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:34.623294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b63e58ee-2b23-4c43-9590-34540d54921c tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 200 len: 1656 microversion: 2.20 time: 0.111043 May 11 21:11:34.623851 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 456/911] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:11:34 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 1656 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 21:11:34.753148 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-bfcb5e5c-fd68-4c1e-9e0c-4816f4a21dc5 req-f24d2e24-4f9b-4948-b2aa-4cb676993444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f00c24-95f0-4551-990e-c18813091765", "name": "network-vif-deleted", "tag": "f03f2724-557a-44bf-a2f6-34c8f1d25081"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:34.761795 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-bfcb5e5c-fd68-4c1e-9e0c-4816f4a21dc5 req-f24d2e24-4f9b-4948-b2aa-4cb676993444 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:34.762405 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-bfcb5e5c-fd68-4c1e-9e0c-4816f4a21dc5 req-f24d2e24-4f9b-4948-b2aa-4cb676993444 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:34.777303 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-bfcb5e5c-fd68-4c1e-9e0c-4816f4a21dc5 req-f24d2e24-4f9b-4948-b2aa-4cb676993444 service nova] Creating event network-vif-deleted:f03f2724-557a-44bf-a2f6-34c8f1d25081 for instance b2f00c24-95f0-4551-990e-c18813091765 on hv-cinder-84146 May 11 21:11:34.782726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-bfcb5e5c-fd68-4c1e-9e0c-4816f4a21dc5 req-f24d2e24-4f9b-4948-b2aa-4cb676993444 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032932 May 11 21:11:34.786305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 456/912] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:35.148612 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:35.149980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:35.156883 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:35.157501 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:35.158550 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:35.159199 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:35.174073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] HTTP exception thrown: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Request method failure captured: May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 HTTP/1.1 May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCT4gBeOwXwRv25_24TWrP10tt7MS4_EyKFpWEuAogO0rV6ASvHNXAd_l_VqMn9bll-uwO7qAHpNZlA-CVBR1K-G92TJrvAK2KoxLWaEGWZz-FtQPwHkpP4H-XE4yVUoNXqhqMe8_BJ2TuU-SbEWBuYpay4iCTjwlI4tel-RC8a0Uds May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:35.176015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: f9968edcee104432ade2014e39683bb5 May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.177450 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '925e3d97-64b1-4637-9850-0c37d5f2a870'} May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:35.182064 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.183596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.185127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Returning 404 to user: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:35.185127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-97800381-0a93-4df8-b08d-1abca038460d tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "DELETE /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 404 len: 111 microversion: 2.1 time: 0.049001 May 11 21:11:35.185127 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 457/913] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:11:35 2022] DELETE /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:35.188565 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:35.189265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] [instance: 925e3d97-64b1-4637-9850-0c37d5f2a870] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:35.196578 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:35.197237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:35.198478 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:35.199082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:35.214660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] HTTP exception thrown: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Request method failure captured: May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 HTTP/1.1 May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCT4gBeOwXwRv25_24TWrP10tt7MS4_EyKFpWEuAogO0rV6ASvHNXAd_l_VqMn9bll-uwO7qAHpNZlA-CVBR1K-G92TJrvAK2KoxLWaEGWZz-FtQPwHkpP4H-XE4yVUoNXqhqMe8_BJ2TuU-SbEWBuYpay4iCTjwlI4tel-RC8a0Uds May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:35.216546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/513637db58d34fe198b2de93d2cbbeaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 513637db58d34fe198b2de93d2cbbeaa May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeTestJSON-791683183 May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: f9968edcee104432ade2014e39683bb5 May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeTestJSON-791683183-project May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.218243 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '925e3d97-64b1-4637-9850-0c37d5f2a870'} May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:35.219168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. May 11 21:11:35.220667 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:35.222684 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] Returning 404 to user: Instance 925e3d97-64b1-4637-9850-0c37d5f2a870 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:35.223565 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5db3d5a1-dbae-45e8-ad81-576471b9342c tempest-AttachVolumeTestJSON-791683183 tempest-AttachVolumeTestJSON-791683183-project] 10.222.0.35 "GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870" status: 404 len: 111 microversion: 2.1 time: 0.039571 May 11 21:11:35.224193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 457/914] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:35 2022] GET /compute/v2.1/servers/925e3d97-64b1-4637-9850-0c37d5f2a870 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:35.642714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:35.643613 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:35.650073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:35.650520 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:35.652073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:35.652513 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:35.670856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] HTTP exception thrown: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Request method failure captured: May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 HTTP/1.1 May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCUAEkSrshwpMIJati8jMU53pn_s2-5-blewRzQktTw4QDRn4ZJ6s4rls9w2fqvbwxHPjux3UhdUSmnCiTIR6c4GQy8epyWQDkh0PPRu8l5fp2_fGgx66Gxd4bcfxrN97yUyXyzhOcYYOkvKmeZ6cQo3Dy1pbDkfSPEoCkcocIeGaIE May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Openstack-Nova-Api-Version: 2.20 May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:35.677074 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d7666a6299cc4c44ac7495ed00f137dd May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:35.678769 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b2f00c24-95f0-4551-990e-c18813091765'} May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:35.680415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:35.682719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:35.684995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Returning 404 to user: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:35.684995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2cbd7a33-fc17-4416-a5c0-287694dba2b4 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 404 len: 111 microversion: 2.20 time: 0.040447 May 11 21:11:35.684995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 458/915] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:11:35 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 11 21:11:35.687990 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4862942f-e57f-4228-8e92-95859142efc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '.version_select at 0x7ff8927994c0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:35.777911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4862942f-e57f-4228-8e92-95859142efc5 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-55649486" status: 204 len: 0 microversion: 2.20 time: 0.093540 May 11 21:11:35.778779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 458/916] 10.222.0.35 () {60 vars in 1255 bytes} [Wed May 11 21:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-55649486 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 21:11:38.378432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:38.379151 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:38.399783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:38.399783 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:38.400464 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:38.401155 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:38.416282 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] HTTP exception thrown: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Request method failure captured: May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 HTTP/1.1 May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCUAEkSrshwpMIJati8jMU53pn_s2-5-blewRzQktTw4QDRn4ZJ6s4rls9w2fqvbwxHPjux3UhdUSmnCiTIR6c4GQy8epyWQDkh0PPRu8l5fp2_fGgx66Gxd4bcfxrN97yUyXyzhOcYYOkvKmeZ6cQo3Dy1pbDkfSPEoCkcocIeGaIE May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Openstack-Nova-Api-Version: 2.20 May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:38.424633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d7666a6299cc4c44ac7495ed00f137dd May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.426375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b2f00c24-95f0-4551-990e-c18813091765'} May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:38.427298 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.428801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:38.434326 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Returning 404 to user: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:38.434326 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6537a171-fe67-487d-b769-ba6b31d2b2a6 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 404 len: 111 microversion: 2.20 time: 0.058833 May 11 21:11:38.438895 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 459/917] 10.222.0.35 () {60 vars in 1279 bytes} [Wed May 11 21:11:38 2022] DELETE /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 21:11:38.443495 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:38.444206 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b2f00c24-95f0-4551-990e-c18813091765] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:38.460087 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:38.460572 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:38.461351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:38.461819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:38.480392 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] HTTP exception thrown: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Request method failure captured: May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 HTTP/1.1 May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCUAEkSrshwpMIJati8jMU53pn_s2-5-blewRzQktTw4QDRn4ZJ6s4rls9w2fqvbwxHPjux3UhdUSmnCiTIR6c4GQy8epyWQDkh0PPRu8l5fp2_fGgx66Gxd4bcfxrN97yUyXyzhOcYYOkvKmeZ6cQo3Dy1pbDkfSPEoCkcocIeGaIE May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Openstack-Nova-Api-Version: 2.20 May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:38.482084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: d7666a6299cc4c44ac7495ed00f137dd May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.483764 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'b2f00c24-95f0-4551-990e-c18813091765'} May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:38.484675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. May 11 21:11:38.486202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:38.487635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Returning 404 to user: Instance b2f00c24-95f0-4551-990e-c18813091765 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:38.487635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dd280cf6-ee8e-4fd2-abc8-04bdce37a077 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765" status: 404 len: 111 microversion: 2.20 time: 0.043699 May 11 21:11:38.487635 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 459/918] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:11:38 2022] GET /compute/v2.1/servers/b2f00c24-95f0-4551-990e-c18813091765 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 11 21:11:39.814461 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:39.814989 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:39.821351 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:39.821832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:39.822600 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:39.823038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:39.836642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] HTTP exception thrown: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Request method failure captured: May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 HTTP/1.1 May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCUAEkSrshwpMIJati8jMU53pn_s2-5-blewRzQktTw4QDRn4ZJ6s4rls9w2fqvbwxHPjux3UhdUSmnCiTIR6c4GQy8epyWQDkh0PPRu8l5fp2_fGgx66Gxd4bcfxrN97yUyXyzhOcYYOkvKmeZ6cQo3Dy1pbDkfSPEoCkcocIeGaIE May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Openstack-Nova-Api-Version: 2.20 May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:39.838222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: d7666a6299cc4c44ac7495ed00f137dd May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.839677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b1e6f4c2-0bcd-4a54-854f-638f98f48a25'} May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:39.840505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.841815 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:39.843083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Returning 404 to user: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:39.843083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8eed8bdd-39f7-42a1-8405-3c136167ea79 tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 404 len: 111 microversion: 2.20 time: 0.029020 May 11 21:11:39.843083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 460/919] 10.222.0.35 () {60 vars in 1279 bytes} [Wed May 11 21:11:39 2022] DELETE /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 21:11:39.848820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:39.856176 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] [instance: b1e6f4c2-0bcd-4a54-854f-638f98f48a25] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:39.857094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:39.860040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:39.860040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:39.860736 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:39.879819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] HTTP exception thrown: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Request method failure captured: May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 HTTP/1.1 May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCUAEkSrshwpMIJati8jMU53pn_s2-5-blewRzQktTw4QDRn4ZJ6s4rls9w2fqvbwxHPjux3UhdUSmnCiTIR6c4GQy8epyWQDkh0PPRu8l5fp2_fGgx66Gxd4bcfxrN97yUyXyzhOcYYOkvKmeZ6cQo3Dy1pbDkfSPEoCkcocIeGaIE May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Openstack-Nova-Api-Version: 2.20 May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:11:39.881514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/54d75c229dc14e59b53a1ec63a0f00f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 54d75c229dc14e59b53a1ec63a0f00f8 May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-263021815 May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: d7666a6299cc4c44ac7495ed00f137dd May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-AttachVolumeShelveTestJSON-263021815-project May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.883527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'b1e6f4c2-0bcd-4a54-854f-638f98f48a25'} May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:39.884285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. May 11 21:11:39.887029 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:11:39.888537 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] Returning 404 to user: Instance b1e6f4c2-0bcd-4a54-854f-638f98f48a25 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:39.888537 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ace1cb09-9a21-48d2-b921-b7138358225f tempest-AttachVolumeShelveTestJSON-263021815 tempest-AttachVolumeShelveTestJSON-263021815-project] 10.222.0.35 "GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25" status: 404 len: 111 microversion: 2.20 time: 0.039253 May 11 21:11:39.888537 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 460/920] 10.222.0.35 () {60 vars in 1276 bytes} [Wed May 11 21:11:39 2022] GET /compute/v2.1/servers/b1e6f4c2-0bcd-4a54-854f-638f98f48a25 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 21:11:47.836084 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d5732bb2-9559-459f-8535-d05c8ee2d94f tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Action: 'create', calling method: .version_select at 0x7ff89c2ebee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1850445421", "metadata": {"Type": "work"}}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:48.538475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d5732bb2-9559-459f-8535-d05c8ee2d94f tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] 10.222.0.35 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.953433 May 11 21:11:48.545942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 461/921] 10.222.0.35 () {60 vars in 1155 bytes} [Wed May 11 21:11:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 962 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 21:11:48.550743 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7942efa4-e8ba-4e6d-a64e-24173a316c92 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Calling method '.version_select at 0x7ff8927999d0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:48.606086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7942efa4-e8ba-4e6d-a64e-24173a316c92 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435" status: 200 len: 353 microversion: 2.1 time: 0.058834 May 11 21:11:48.607190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 461/922] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:11:48 2022] GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:49.619281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9e2d0e7b-7092-440b-8084-90dd4bb55bac tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Calling method '.version_select at 0x7ff89c2a7550>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:49.667829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9e2d0e7b-7092-440b-8084-90dd4bb55bac tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435" status: 200 len: 354 microversion: 2.1 time: 0.052804 May 11 21:11:49.668933 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 462/923] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:11:49 2022] GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:49.690484 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1c3c2b70-3631-48cd-8204-81b536b9c2d2 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Calling method '.version_select at 0x7ff89278c3a0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:49.742156 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1c3c2b70-3631-48cd-8204-81b536b9c2d2 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435" status: 200 len: 354 microversion: 2.1 time: 0.055985 May 11 21:11:49.742921 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 462/924] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:11:49 2022] GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:49.759460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e49df9e4-9d76-4984-a498-c13d5bf75593 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Calling method '.version_select at 0x7ff89c2cb700>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:50.011874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e49df9e4-9d76-4984-a498-c13d5bf75593 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] 10.222.0.35 "DELETE /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435" status: 202 len: 0 microversion: 2.1 time: 0.255786 May 11 21:11:50.012411 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 463/925] 10.222.0.35 () {58 vars in 1247 bytes} [Wed May 11 21:11:49 2022] DELETE /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:11:50.026740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-18ce6938-0236-4a4a-80da-eed2eeff3869 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Calling method '.version_select at 0x7ff8927289d0>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:50.081439 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-18ce6938-0236-4a4a-80da-eed2eeff3869 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435" status: 200 len: 353 microversion: 2.1 time: 0.064570 May 11 21:11:50.082128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 463/926] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:11:50 2022] GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:51.094663 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-391dfad3-5019-449a-8e85-538089969cc1 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Calling method '.version_select at 0x7ff8981ca790>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:51.186985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-391dfad3-5019-449a-8e85-538089969cc1 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] HTTP exception thrown: Volume 30faab9b-f90f-4b0b-bace-0910a2364435 could not be found. May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-391dfad3-5019-449a-8e85-538089969cc1 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Request method failure captured: May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435 HTTP/1.1 May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCaTAfLxvCdcNLTYqkQGWHYFtMcRd07ewNdEfkIs67whhBIoI7F247Ts5USz72l2NSF5JgjFjBkDHu1fbIvj4dAhn6xbgqduHakLa95OptTldm3PF8wITh4M6sToxIq7IeSfzEW_cn92gbB3xZJ2fy2TIh8twXse7XiDNsvFYlqQgEk May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 239c6c8c35ab43c49a07d035b15002a9 May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesGetTestJSON-1356640244 May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:11:51.189132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/239c6c8c35ab43c49a07d035b15002a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_239c6c8c35ab43c49a07d035b15002a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/239c6c8c35ab43c49a07d035b15002a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/239c6c8c35ab43c49a07d035b15002a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesGetTestJSON-1356640244 May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 239c6c8c35ab43c49a07d035b15002a9 May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesGetTestJSON-1356640244 May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesGetTestJSON-1356640244-project May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: fe15b01a48f84e59b5d7ff8824b11c2e May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesGetTestJSON-1356640244-project May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Volume 30faab9b-f90f-4b0b-bace-0910a2364435 could not be found. May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '30faab9b-f90f-4b0b-bace-0910a2364435'} May 11 21:11:51.190854 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30faab9b-f90f-4b0b-bace-0910a2364435 could not be found. (HTTP 404) (Request-ID: req-beee44af-0262-4fc8-b34f-687547ba0bd7) May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:51.192467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 21:11:51.194744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30faab9b-f90f-4b0b-bace-0910a2364435 could not be found. May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 21:11:51.197131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30faab9b-f90f-4b0b-bace-0910a2364435 could not be found. May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30faab9b-f90f-4b0b-bace-0910a2364435 could not be found. May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-391dfad3-5019-449a-8e85-538089969cc1 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] Returning 404 to user: Volume 30faab9b-f90f-4b0b-bace-0910a2364435 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-391dfad3-5019-449a-8e85-538089969cc1 tempest-VolumesGetTestJSON-1356640244 tempest-VolumesGetTestJSON-1356640244-project] 10.222.0.35 "GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435" status: 404 len: 109 microversion: 2.1 time: 0.100450 May 11 21:11:51.198722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 464/927] 10.222.0.35 () {58 vars in 1244 bytes} [Wed May 11 21:11:51 2022] GET /compute/v2.1/os-volumes/30faab9b-f90f-4b0b-bace-0910a2364435 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:11:52.552137 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1987733594", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "networks": [{"uuid": "450bdbb1-35fe-459c-a04c-28698ec4e58c"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:52.605149 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] validate_networks() for [('450bdbb1-35fe-459c-a04c-28698ec4e58c', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:11:53.238601 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:11:53.243643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:11:53.243643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:11:53.243643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:11:53.243643 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:11:53.249718 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:53.250166 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:53.251003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:53.251440 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:53.268711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Getting quotas for project b37271fa94bf4dd7b16f144dbb9c049c. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:11:53.272711 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Getting quotas for user 98cd883e05da4e5798ad64e7a43bfed1 and project b37271fa94bf4dd7b16f144dbb9c049c. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:11:53.283776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:11:53.286106 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:11:53.430822 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9b1ae028-91bd-4e31-a5c2-7815c1bde668 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882417 May 11 21:11:53.432078 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 464/928] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:11:53.442476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-864fdda2-2bc5-456d-b583-1508331f7b3b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:53.443238 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-864fdda2-2bc5-456d-b583-1508331f7b3b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:53.501888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-864fdda2-2bc5-456d-b583-1508331f7b3b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:53.509088 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-864fdda2-2bc5-456d-b583-1508331f7b3b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1219 microversion: 2.1 time: 0.071352 May 11 21:11:53.509906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 465/929] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:53 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:54.526837 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-163271f4-dff1-48c3-9724-b0d0b4d7f631 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:54.527752 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-163271f4-dff1-48c3-9724-b0d0b4d7f631 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:54.580845 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-163271f4-dff1-48c3-9724-b0d0b4d7f631 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:54.588071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-163271f4-dff1-48c3-9724-b0d0b4d7f631 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1219 microversion: 2.1 time: 0.065609 May 11 21:11:54.588624 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 465/930] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:54 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:11:55.604588 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:55.605192 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:55.611889 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:55.612403 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:55.613137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:55.613591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:55.684756 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:55.692402 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-94bc5021-0d86-421c-8c00-e77c978df134 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1271 microversion: 2.1 time: 0.091727 May 11 21:11:55.693144 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 466/931] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:55 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:56.710359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:56.711528 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:56.719309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:56.719757 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:56.720531 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:56.721140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:56.903444 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:56.912891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4dd677b8-3329-4b36-a3ea-530d3b8cf33a tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.206740 May 11 21:11:56.913740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 466/932] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:56 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:57.668378 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-457e0478-3bc7-459d-9178-30767b0998bc req-d63fbda6-7093-4102-be59-6086c291232a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94da2dee-e1d4-4ce0-84ff-5729c118787a", "tag": "44182e4a-d521-4b84-91d5-3119295fd01b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:11:57.676234 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-457e0478-3bc7-459d-9178-30767b0998bc req-d63fbda6-7093-4102-be59-6086c291232a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:57.676677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-457e0478-3bc7-459d-9178-30767b0998bc req-d63fbda6-7093-4102-be59-6086c291232a service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:57.687882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-457e0478-3bc7-459d-9178-30767b0998bc req-d63fbda6-7093-4102-be59-6086c291232a service nova] Creating event network-changed:44182e4a-d521-4b84-91d5-3119295fd01b for instance 94da2dee-e1d4-4ce0-84ff-5729c118787a on hv-cinder-84146 May 11 21:11:57.693752 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-457e0478-3bc7-459d-9178-30767b0998bc req-d63fbda6-7093-4102-be59-6086c291232a service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029445 May 11 21:11:57.694530 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 467/933] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:11:57.931496 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:57.932626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:57.939486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:57.950626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:57.950626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:57.950626 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:58.147089 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:58.154860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-8548a50d-f492-4a49-9534-b58874f197cf tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.227940 May 11 21:11:58.155429 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 467/934] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:57 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:11:59.172272 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:11:59.173082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:11:59.179615 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:59.180054 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:59.181306 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:11:59.181765 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:11:59.309103 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:11:59.316303 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-17a55859-f011-427a-af60-2b4b5f3b3d66 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.148229 May 11 21:11:59.316887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 468/935] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:11:59 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:00.333932 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:00.334689 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:00.342033 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:00.342479 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:00.343314 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:00.343728 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:00.473748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:00.480917 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a337cc7c-a0ec-4da4-b204-2d0f1fff418c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.150892 May 11 21:12:00.481473 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 468/936] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:00 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:12:01.497742 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:01.498341 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:01.504573 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:01.505017 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:01.505802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:01.506235 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:01.636063 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:01.643293 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f0bc4d72-f891-458f-b434-68995730ea43 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.149392 May 11 21:12:01.643861 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 469/937] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:01 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:02.660836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:02.661449 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:02.668511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:02.668960 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:02.669920 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:02.670201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:02.808030 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:02.815254 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-afe6be75-e692-46fe-9594-fc6aa8624f2c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.158241 May 11 21:12:02.815846 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 469/938] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:02 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:03.831642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:03.832249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:03.838718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:03.840462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:03.840462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:03.841029 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:03.982534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:03.989812 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5a176ac2-1ccc-41e3-8e60-f3464a5a1bfd tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.162075 May 11 21:12:03.990376 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 470/939] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:03 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:04.087297 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-1b11e523-ee8c-4a5a-b095-4d3836073884 req-5358286a-4900-4e4c-b2cb-3db4db8ed1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94da2dee-e1d4-4ce0-84ff-5729c118787a", "name": "network-vif-plugged", "status": "completed", "tag": "44182e4a-d521-4b84-91d5-3119295fd01b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:12:04.091906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-1b11e523-ee8c-4a5a-b095-4d3836073884 req-5358286a-4900-4e4c-b2cb-3db4db8ed1fd service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:04.092362 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-1b11e523-ee8c-4a5a-b095-4d3836073884 req-5358286a-4900-4e4c-b2cb-3db4db8ed1fd service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:04.102882 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-1b11e523-ee8c-4a5a-b095-4d3836073884 req-5358286a-4900-4e4c-b2cb-3db4db8ed1fd service nova] Creating event network-vif-plugged:44182e4a-d521-4b84-91d5-3119295fd01b for instance 94da2dee-e1d4-4ce0-84ff-5729c118787a on hv-cinder-84146 May 11 21:12:04.108623 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-1b11e523-ee8c-4a5a-b095-4d3836073884 req-5358286a-4900-4e4c-b2cb-3db4db8ed1fd service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028664 May 11 21:12:04.109356 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 470/940] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:12:05.007248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:05.007850 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:05.014153 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:05.014605 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:05.015364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:05.015793 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:05.144692 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:05.152725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9df1f50c-462e-436f-8bf8-ef42ea847e81 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.149436 May 11 21:12:05.153280 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 471/941] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:05 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:06.170999 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:06.171700 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:06.181126 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:06.181126 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:06.181126 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:06.181126 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:06.309766 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:06.317026 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-19f3d240-d485-42b5-af1c-d4919690cf24 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.151303 May 11 21:12:06.317614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 471/942] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:06 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:07.333823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:07.334432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:07.340697 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:07.350087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:07.350087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:07.350087 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:07.469827 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:07.477600 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ebb829bd-52a4-4e84-bfb8-1adbf38932c1 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.147674 May 11 21:12:07.478160 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 472/943] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:07 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:08.494850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:08.495935 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:08.501780 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:08.502227 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:08.502994 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:08.503424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:08.645356 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:08.654258 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dcda16ec-2100-4601-b118-ff17b391b690 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1319 microversion: 2.1 time: 0.163288 May 11 21:12:08.655367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 472/944] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:08 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:09.671548 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:09.672154 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:09.678504 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:09.678947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:09.679704 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:09.680133 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:09.806175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:12:09.813732 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7b979ac6-0ba5-48b7-a56f-4babf5dae859 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1508 microversion: 2.1 time: 0.146591 May 11 21:12:09.814311 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 473/945] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:12:09 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:12:32.917394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0ed841f0-8158-4113-8f84-593d23508081 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "530968a3-5779-4b15-93b4-627be3687414", "device": "/dev/sdb"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:12:32.919014 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0ed841f0-8158-4113-8f84-593d23508081 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:32.925157 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ed841f0-8158-4113-8f84-593d23508081 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:32.929486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ed841f0-8158-4113-8f84-593d23508081 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:32.929486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ed841f0-8158-4113-8f84-593d23508081 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:32.929486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0ed841f0-8158-4113-8f84-593d23508081 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:33.857673 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0ed841f0-8158-4113-8f84-593d23508081 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "POST /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.943735 May 11 21:12:33.859153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 473/946] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:12:32 2022] POST /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:12:59.068547 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:12:59.069202 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:12:59.075109 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:59.075548 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:59.076306 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:12:59.076730 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:12:59.159196 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lazy-loading 'services' on Instance uuid 94da2dee-e1d4-4ce0-84ff-5729c118787a {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:12:59.420052 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-95aa9397-9dc5-4051-bbc7-709dbfdb052f tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "DELETE /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a/os-volume_attachments/530968a3-5779-4b15-93b4-627be3687414" status: 202 len: 0 microversion: 2.1 time: 0.355162 May 11 21:12:59.420921 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 474/947] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:12:59 2022] DELETE /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a/os-volume_attachments/530968a3-5779-4b15-93b4-627be3687414 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:13:00.578456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:00.583465 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:00.587572 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:00.588435 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:00.589501 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:00.590201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:00.627166 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:13:00.940540 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e2c779c1-da44-4578-a1ea-da013431b1d5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "DELETE /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 204 len: 0 microversion: 2.1 time: 0.367033 May 11 21:13:00.941131 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 474/948] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:13:00 2022] DELETE /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:13:00.950499 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:00.951900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:00.958915 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:00.959370 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:00.960152 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:00.960599 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:01.106621 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:01.114823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d1773c6d-d453-40bc-bdb9-23cdce6e732c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1514 microversion: 2.1 time: 0.169099 May 11 21:13:01.115705 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 475/949] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:00 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:02.133608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:02.134381 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:02.142063 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:02.142577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:02.143393 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:02.143830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:02.296235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:02.303674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ca6907ba-b247-4d7a-8528-d3ae792cb2fe tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1514 microversion: 2.1 time: 0.174771 May 11 21:13:02.304241 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 475/950] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:02 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:03.165240 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1edb2c62-5c58-477b-9841-9478f16d3d9c tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Action: 'create', calling method: .version_select at 0x7ff8981f2820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-746266023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIBSeh0w8NjAdqdMjaFDHVnG3u15Jhy3kv3HrLhHA+O0Dah7tdDmWLC8NlMVCxgdh2K9bQYpA+OKIaUvTvzOHTvuybg8Um8WCKQWwc9oBHnWtEOCKemmBxKV4xarWEOGg=="}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:03.184767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-1edb2c62-5c58-477b-9841-9478f16d3d9c tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Getting quotas for project ffc2f645c2fb4fb1baf86bfa44be2d56. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:13:03.189997 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-1edb2c62-5c58-477b-9841-9478f16d3d9c tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Getting quotas for user 5f921c3ec5a44c49a6ee9903e56b6d62 and project ffc2f645c2fb4fb1baf86bfa44be2d56. Resources: {'key_pairs'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:13:03.202906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1edb2c62-5c58-477b-9841-9478f16d3d9c tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [71c6f054-2433-4fd9-88b0-675ff5d8e3d9] AMQP server on 10.222.0.35:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 11 21:13:03.234570 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-810c9fa1-cd4d-44d6-8caa-f42e84535835 req-930f1ff3-599e-4e5e-8ce4-eac9b679ebdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94da2dee-e1d4-4ce0-84ff-5729c118787a", "name": "network-vif-deleted", "tag": "44182e4a-d521-4b84-91d5-3119295fd01b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:03.243339 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-810c9fa1-cd4d-44d6-8caa-f42e84535835 req-930f1ff3-599e-4e5e-8ce4-eac9b679ebdf service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:03.243901 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-810c9fa1-cd4d-44d6-8caa-f42e84535835 req-930f1ff3-599e-4e5e-8ce4-eac9b679ebdf service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:03.254519 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-810c9fa1-cd4d-44d6-8caa-f42e84535835 req-930f1ff3-599e-4e5e-8ce4-eac9b679ebdf service nova] Creating event network-vif-deleted:44182e4a-d521-4b84-91d5-3119295fd01b for instance 94da2dee-e1d4-4ce0-84ff-5729c118787a on hv-cinder-84146 May 11 21:13:03.259397 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-810c9fa1-cd4d-44d6-8caa-f42e84535835 req-930f1ff3-599e-4e5e-8ce4-eac9b679ebdf service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028772 May 11 21:13:03.260962 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 476/951] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:13:03.321908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:03.322608 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:03.328722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:03.329171 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:03.330022 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:03.330399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:03.397295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:03.405061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-212a4843-5c3a-4138-aafe-07221901b198 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 200 len: 1472 microversion: 2.1 time: 0.087681 May 11 21:13:03.405797 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 477/952] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:03 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 1472 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:04.210838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [None req-1edb2c62-5c58-477b-9841-9478f16d3d9c tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [71c6f054-2433-4fd9-88b0-675ff5d8e3d9] Reconnected to AMQP server on 10.222.0.35:5672 via [amqp] client with port 56836. May 11 21:13:04.305776 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1edb2c62-5c58-477b-9841-9478f16d3d9c tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.144722 May 11 21:13:04.306596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 476/953] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:13:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:04.403484 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1122769145", "imageRef": "22d367a9-ff93-460d-838a-caba4f8499d3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-746266023", "networks": [{"uuid": "f01e4790-8167-4598-92e2-db182365e1c6"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:04.423566 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:04.424197 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 94da2dee-e1d4-4ce0-84ff-5729c118787a] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:04.430789 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:04.431234 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:04.432106 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:04.432582 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] HTTP exception thrown: Instance 94da2dee-e1d4-4ce0-84ff-5729c118787a could not be found. May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Request method failure captured: May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a HTTP/1.1 May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCaWKMY2WKZtXLHNwFJfxQIdD59_X8RxuH4deGsdmNxlJ_nssJKzUpVZBYah6Rk-cV16E3RLb1AUzgf6OGrFuhJWRxyuv64tdkjLWPDSBDPuoggtGf-qgpLE5K-hLQ9TpI_1NPewlhEU-bxGV5lDl2Dg9nFzWpk5p24cpw99o7GyfUM May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: b37271fa94bf4dd7b16f144dbb9c049c May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-VolumesSnapshotTestJSON-257129253 May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:13:04.457995 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-VolumesSnapshotTestJSON-257129253 May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: b37271fa94bf4dd7b16f144dbb9c049c May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-257129253 May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-VolumesSnapshotTestJSON-257129253-project May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: 98cd883e05da4e5798ad64e7a43bfed1 May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-VolumesSnapshotTestJSON-257129253-project May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance 94da2dee-e1d4-4ce0-84ff-5729c118787a could not be found. May 11 21:13:04.459534 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': '94da2dee-e1d4-4ce0-84ff-5729c118787a'} May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94da2dee-e1d4-4ce0-84ff-5729c118787a could not be found. May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:13:04.460531 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94da2dee-e1d4-4ce0-84ff-5729c118787a could not be found. May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94da2dee-e1d4-4ce0-84ff-5729c118787a could not be found. May 11 21:13:04.462369 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:13:04.463891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Returning 404 to user: Instance 94da2dee-e1d4-4ce0-84ff-5729c118787a could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:13:04.463891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-330e51f2-4e32-456d-839f-6a190bc790b5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a" status: 404 len: 111 microversion: 2.1 time: 0.031978 May 11 21:13:04.463891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 477/954] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:04 2022] GET /compute/v2.1/servers/94da2dee-e1d4-4ce0-84ff-5729c118787a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 21:13:04.464158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] validate_networks() for [('f01e4790-8167-4598-92e2-db182365e1c6', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:13:04.819820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:13:04.825153 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:13:04.825880 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:13:04.826368 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:13:04.826855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:13:04.844749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:04.845228 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:04.846138 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:04.846577 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:04.863326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Getting quotas for project ffc2f645c2fb4fb1baf86bfa44be2d56. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:13:04.867252 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Getting quotas for user 5f921c3ec5a44c49a6ee9903e56b6d62 and project ffc2f645c2fb4fb1baf86bfa44be2d56. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:13:04.878691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:13:04.880902 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d367a9-ff93-460d-838a-caba4f8499d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:13:04.998235 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bd641d4e-1fd5-4a19-aabf-149044731f42 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598769 May 11 21:13:04.998804 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 478/955] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:13:05.020947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-75c7febe-f68d-4c04-8037-f16007f3e056 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:05.021978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-75c7febe-f68d-4c04-8037-f16007f3e056 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:05.074082 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-75c7febe-f68d-4c04-8037-f16007f3e056 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:05.081270 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-75c7febe-f68d-4c04-8037-f16007f3e056 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1258 microversion: 2.1 time: 0.064991 May 11 21:13:05.081776 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 478/956] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:05 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:06.099393 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:06.099998 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:06.106423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:06.106867 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:06.107620 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:06.108049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:06.168614 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:06.175889 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7dc88e8c-04bc-43eb-9a4f-a47ace21f878 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1262 microversion: 2.1 time: 0.082169 May 11 21:13:06.176443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 479/957] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:06 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:07.192223 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:07.192798 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:07.199745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:07.200189 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:07.200938 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:07.201364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:07.259143 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:07.266195 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3a1861a2-f789-4cee-826d-f76da9187384 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1262 microversion: 2.1 time: 0.077909 May 11 21:13:07.266745 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 479/958] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:07 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:08.283003 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:08.283604 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:08.289779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:08.290220 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:08.290968 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:08.291402 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:08.349276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:08.356386 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-170b3ba5-64d8-4cf1-9764-3e0d08d654e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1254 microversion: 2.1 time: 0.077185 May 11 21:13:08.356961 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 480/959] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:08 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1254 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:09.374077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:09.374620 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:09.381341 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:09.381814 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:09.382579 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:09.383046 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:09.442104 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:09.449370 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-cfb7d0e2-d690-44b1-b3fd-d85e54778bf8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1254 microversion: 2.1 time: 0.079228 May 11 21:13:09.449972 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 480/960] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:09 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1254 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:10.466350 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:10.466995 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:10.474063 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:10.474511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:10.475269 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:10.475700 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:10.535475 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:10.542755 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4d9fb857-20b2-4208-be2c-ec905e153d9d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1310 microversion: 2.1 time: 0.080149 May 11 21:13:10.543311 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 481/961] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:10 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:11.559329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:11.559938 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:11.566223 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:11.566673 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:11.567433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:11.567864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:11.630179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:11.637311 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-76a0cf07-fbf6-4d49-ac52-9bdb3e5f1330 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1318 microversion: 2.1 time: 0.081812 May 11 21:13:11.637886 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 481/962] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:11 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1318 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:12.654461 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:12.655089 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:12.661501 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:12.661996 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:12.662750 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:12.663181 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:12.724261 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:12.731351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a4ae204c-9726-4202-8f2f-57002c64c47d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1318 microversion: 2.1 time: 0.081004 May 11 21:13:12.731904 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 482/963] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:12 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1318 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:13.748576 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:13.749207 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:13.756399 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:13.756856 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:13.757666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:13.758107 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:13.820830 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:13.828173 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bc399998-1657-48fe-a210-6cb192210aea tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1328 microversion: 2.1 time: 0.083494 May 11 21:13:13.828985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 482/964] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:13 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1328 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:14.846750 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:14.847368 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:14.853438 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:14.853929 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:14.854695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:14.855130 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:14.982194 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:14.991936 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2b38070d-0d0e-43f1-8e97-f8741ab58dab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.149074 May 11 21:13:14.992340 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 483/965] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:14 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:16.009056 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:16.010434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:16.018394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:16.019189 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:16.020227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:16.020997 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:16.170010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:16.179167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-50744551-8834-4983-a7af-99d131e7c552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.174789 May 11 21:13:16.179747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 483/966] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:16 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:17.197276 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:17.198131 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:17.205771 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:17.206367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:17.207260 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:17.207988 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:17.353350 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:17.367211 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9b5ff3b0-f397-4a21-b911-c10d87299761 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.168602 May 11 21:13:17.367211 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 484/967] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:17 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:18.380942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:18.381682 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:18.389308 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:18.389912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:18.390882 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:18.391488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:18.532248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:18.541036 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-07814b72-b128-4d70-a543-1a11de0926b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.164876 May 11 21:13:18.543288 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 484/968] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:18 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:19.560264 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:19.560872 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:19.568011 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:19.568463 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:19.569223 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:19.569701 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:19.702792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:19.710663 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-31996b4e-40f1-4d20-ac9a-4d9e4a859fdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.154806 May 11 21:13:19.711229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 485/969] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:19 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:20.727691 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:20.728521 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:20.737513 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:20.738274 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:20.739596 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:20.740281 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:21.061734 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:21.072972 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d4a25f92-1529-4b85-a5fe-0b0e5b594ad6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.348793 May 11 21:13:21.073871 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 485/970] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:20 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:21.112896 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1768770303", "imageRef": "b42e2177-d32a-4b32-b2e6-424edf2dcbd1", "flavorRef": "452", "networks": [{"uuid": "450bdbb1-35fe-459c-a04c-28698ec4e58c"}]}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:21.167250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.network.neutron [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] validate_networks() for [('450bdbb1-35fe-459c-a04c-28698ec4e58c', None, None, None, None, None)] {{(pid=117611) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:13:21.542774 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Flavor limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:13:21.543191 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Image limits 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:13:21.543656 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Flavor pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:13:21.544058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Image pref 0:0:0 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:13:21.545558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.virt.hardware [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117611) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:13:21.554936 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:21.555378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:21.556255 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:21.556701 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:21.574140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Getting quotas for project b37271fa94bf4dd7b16f144dbb9c049c. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:13:21.578500 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Getting quotas for user 98cd883e05da4e5798ad64e7a43bfed1 and project b37271fa94bf4dd7b16f144dbb9c049c. Resources: {'instances', 'cores', 'ram'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:13:21.589326 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Going to run 1 instances... {{(pid=117611) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:13:21.591457 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b42e2177-d32a-4b32-b2e6-424edf2dcbd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117611) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:13:21.736603 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ca993477-49d4-423d-b5c5-6181952babd5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626980 May 11 21:13:21.737476 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 486/971] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:13:21.747419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9e453e79-b990-47e8-a993-a9e33f838457 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:21.748699 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9e453e79-b990-47e8-a993-a9e33f838457 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:21.841079 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9e453e79-b990-47e8-a993-a9e33f838457 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:21.848095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9e453e79-b990-47e8-a993-a9e33f838457 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1219 microversion: 2.1 time: 0.104435 May 11 21:13:21.848966 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 486/972] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:21 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:22.090770 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:22.091380 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:22.098047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:22.098499 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:22.099272 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:22.099710 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:22.263736 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:22.273776 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-27ec3880-2f07-45c5-a50c-32fe99a83ac6 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.186784 May 11 21:13:22.274507 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 487/973] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:22 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:22.866253 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:22.867033 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:22.874095 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:22.874552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:22.875340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:22.875779 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:22.941233 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:22.948722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6f36cff5-c61f-49d2-a906-0cc84a9a49f3 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1223 microversion: 2.1 time: 0.087172 May 11 21:13:22.949287 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 487/974] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:22 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:23.294126 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:23.295906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:23.302143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:23.302597 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:23.303494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:23.303961 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:23.437486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:23.445826 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5cd8a7fc-bc44-49e8-8ff5-5f1bad6f7c6a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.156253 May 11 21:13:23.446405 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 488/975] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:23 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:23.575647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-750849594", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1320302024", "security_groups": [{"name": "tempest-secgroup-smoke-644581309"}], "block_device_mapping_v2": [{"uuid": "26652cdc-a736-4fc9-ac41-71fd5eb4aff9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8d33d52-b2cd-4098-87c1-78268014f2dc"}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:23.683453 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] validate_networks() for [('c8d33d52-b2cd-4098-87c1-78268014f2dc', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:13:23.966548 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:23.967559 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:23.973860 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:23.974421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:23.975373 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:23.975983 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:24.057494 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:13:24.058073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:13:24.058635 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:13:24.059035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:13:24.059437 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:13:24.070157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:24.070587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:24.071375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:24.071802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:24.088186 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:13:24.092093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Getting quotas for user 3a47bfbd0a2e459cabaa30d74f45811a and project 31585e8d8c2b4eb0b052b30e2ce5fa63. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:13:24.110735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:24.122678 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b3d709ee-580b-4bef-81f5-5285bf27bd40 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1223 microversion: 2.1 time: 0.160950 May 11 21:13:24.123866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 489/976] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:23 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1223 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:24.161772 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:13:24.163832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26652cdc-a736-4fc9-ac41-71fd5eb4aff9',volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:13:24.465921 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:24.466646 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:24.474437 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:24.474887 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:24.475775 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:24.476454 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:24.659236 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c78b7b14-033a-4719-b536-d34f0a13cc5d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.087325 May 11 21:13:24.662340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 488/977] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:13:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:13:24.671459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9d06c08d-21d1-4b22-89bb-b3f89b29bc39 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:24.672206 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9d06c08d-21d1-4b22-89bb-b3f89b29bc39 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:24.678771 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:24.687454 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-250e72b2-e61b-4466-a7ee-599dd9744190 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.226895 May 11 21:13:24.688784 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 490/978] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:24 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:24.747666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9d06c08d-21d1-4b22-89bb-b3f89b29bc39 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:24.759591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9d06c08d-21d1-4b22-89bb-b3f89b29bc39 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1094 microversion: 2.1 time: 0.089625 May 11 21:13:24.759591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 489/979] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:24 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:24.888375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-240b67a7-33ba-492d-8071-4975b2fa32d4 req-5c8d70fa-01a7-4d4f-97db-639446460d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69317df-5298-4b77-bd58-e2284db8656c", "tag": "a75fd384-059f-48a9-8646-474738a13496"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:24.897161 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-240b67a7-33ba-492d-8071-4975b2fa32d4 req-5c8d70fa-01a7-4d4f-97db-639446460d41 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:24.897480 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-240b67a7-33ba-492d-8071-4975b2fa32d4 req-5c8d70fa-01a7-4d4f-97db-639446460d41 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:24.911158 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-240b67a7-33ba-492d-8071-4975b2fa32d4 req-5c8d70fa-01a7-4d4f-97db-639446460d41 service nova] Creating event network-changed:a75fd384-059f-48a9-8646-474738a13496 for instance f69317df-5298-4b77-bd58-e2284db8656c on hv-cinder-84146 May 11 21:13:24.914456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-240b67a7-33ba-492d-8071-4975b2fa32d4 req-5c8d70fa-01a7-4d4f-97db-639446460d41 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029920 May 11 21:13:24.915050 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 491/980] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:25.140799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:25.141420 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:25.148688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:25.149167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:25.150067 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:25.150759 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:25.240203 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:25.249955 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4bf3e00d-1a59-4c2b-b4ed-7b72bce2fbf5 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1289 microversion: 2.1 time: 0.112710 May 11 21:13:25.250863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 490/981] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:25 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:25.709402 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:25.710160 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:25.716526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:25.717046 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:25.717939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:25.718394 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:25.774619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:25.775232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:25.782172 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:25.782663 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:25.783970 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:25.784413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:25.849681 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:25.857747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8d0a34cd-b868-425b-b8ee-d0e575999a64 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1144 microversion: 2.1 time: 0.086857 May 11 21:13:25.858250 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 491/982] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:25 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:26.038772 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:26.046188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-535fa6ad-c7ab-4eea-b0e8-a25dce080552 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.341712 May 11 21:13:26.046774 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 492/983] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:25 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:26.275803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:26.276423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:26.283693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:26.284145 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:26.284921 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:26.285358 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:26.346864 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:26.354289 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a9afbf0a-1a39-4890-a069-13e2338d2bef tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1277 microversion: 2.1 time: 0.082338 May 11 21:13:26.354841 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 492/984] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:26 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:26.875011 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:26.875613 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:26.882521 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:26.882966 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:26.883716 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:26.884145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:26.946996 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:26.954598 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f9c328e8-01c5-4c9a-8b2f-e2be7744cc24 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1192 microversion: 2.1 time: 0.083453 May 11 21:13:26.955157 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 493/985] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:26 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:27.063483 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:27.064718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:27.070461 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:27.070906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:27.071662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:27.072093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:27.193843 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:27.200929 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-0cf9ef3f-3ba9-4bfa-a105-ecc7a0280fab tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.141298 May 11 21:13:27.201476 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 493/986] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:27 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:27.371324 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:27.371850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:27.377836 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:27.378281 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:27.380637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:27.380637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:27.501940 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:27.508955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b23e1a19-4b09-4b2f-913a-f44b45283290 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.141555 May 11 21:13:27.509507 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 494/987] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:27 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:27.971410 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:27.972017 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:27.978307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:27.978702 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:27.979462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:27.979898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:28.042085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:28.049337 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6f6d2aa2-b3aa-40c6-8c0f-e7def831bca6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1192 microversion: 2.1 time: 0.081803 May 11 21:13:28.050005 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 494/988] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:27 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:28.217389 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:28.218009 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:28.224452 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:28.224894 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:28.225676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:28.226107 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:28.348666 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:28.355829 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2741749c-853f-4dcd-a4f7-ebd03858eb22 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.142278 May 11 21:13:28.356396 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 495/989] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:28 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:28.526046 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:28.526656 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:28.533172 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:28.533696 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:28.534491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:28.534924 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:28.662675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:28.669884 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d7ae2143-ec8c-4a25-a2df-7c2d2fb762c4 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.147799 May 11 21:13:28.670434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 495/990] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:28 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:29.066709 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:29.067447 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:29.074407 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:29.074963 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:29.075877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:29.076385 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:29.148670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:29.156561 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a4ea8b6a-c444-4e95-9374-adc8dad4db8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1192 microversion: 2.1 time: 0.094628 May 11 21:13:29.157348 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 496/991] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:29 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:29.372898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:29.373517 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:29.380688 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:29.381164 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:29.381980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:29.382397 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:29.516739 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:29.524480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4e441091-18bb-44cc-9731-7909fb7f7c75 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.155553 May 11 21:13:29.525040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 496/992] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:29 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:29.636162 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-f68a8087-2400-4293-ac59-58ec3fda3345 req-3a159661-5594-43ac-99fe-cb3c5d342b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc", "tag": "0b2017db-bd51-45f0-bb5b-b3407bb05753"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:29.645418 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f68a8087-2400-4293-ac59-58ec3fda3345 req-3a159661-5594-43ac-99fe-cb3c5d342b54 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:29.645877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-f68a8087-2400-4293-ac59-58ec3fda3345 req-3a159661-5594-43ac-99fe-cb3c5d342b54 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:29.656992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-f68a8087-2400-4293-ac59-58ec3fda3345 req-3a159661-5594-43ac-99fe-cb3c5d342b54 service nova] Creating event network-changed:0b2017db-bd51-45f0-bb5b-b3407bb05753 for instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc on hv-cinder-84146 May 11 21:13:29.661588 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-f68a8087-2400-4293-ac59-58ec3fda3345 req-3a159661-5594-43ac-99fe-cb3c5d342b54 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029167 May 11 21:13:29.662180 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 497/993] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:13:29.688041 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:29.688585 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:29.694987 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:29.695433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:29.696194 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:29.696628 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:29.824591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:29.832059 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3532e503-7e1c-4b56-bd22-3f6577730ca0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.147873 May 11 21:13:29.832612 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 497/994] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:29 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:30.174363 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:30.175135 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:30.181012 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:30.181456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:30.182240 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:30.182675 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:30.266972 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:30.274595 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-9d13b9d3-6627-4395-85b7-e68b4972a135 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1200 microversion: 2.1 time: 0.105144 May 11 21:13:30.284458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 498/995] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:30 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1200 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:30.541888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:30.542496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:30.548820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:30.549322 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:30.550050 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:30.550516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:30.684214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:30.689553 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6e0c538e-13ec-4605-9934-eaba96f18c13 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.151826 May 11 21:13:30.690332 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 498/996] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:30 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:30.851679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:30.852397 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:30.861316 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:30.866735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:30.866735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:30.866735 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:31.144404 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:31.152168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fbf7b94c-0fa7-4b00-9bfb-afa17b731660 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.304928 May 11 21:13:31.153044 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 499/997] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:30 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:31.293987 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:31.294964 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:31.301513 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:31.302764 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:31.303271 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:31.303947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:31.389066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:31.396614 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bbdc9b70-718a-405a-8b6d-9be7c2b88424 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1210 microversion: 2.1 time: 0.106628 May 11 21:13:31.397169 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 499/998] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:31 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:31.706359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:31.708023 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:31.713988 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:31.714516 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:31.715282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:31.715714 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:31.844575 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:31.852291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-3d323a50-4f9a-43fb-91cc-a84e25507ef3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.149837 May 11 21:13:31.852881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 500/999] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:31 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:32.169563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:32.170179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:32.176857 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:32.187475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:32.187475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:32.187475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:32.306008 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:32.314977 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d3a907cb-2300-455e-899a-42591421392c tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.149288 May 11 21:13:32.315536 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 500/1000] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:32 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:32.414109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:32.414791 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:32.421127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:32.421615 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:32.422381 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:32.422945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:32.646351 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:32.653969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5b758944-51c2-4fed-ac7b-42de73288b7b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1277 microversion: 2.1 time: 0.243924 May 11 21:13:32.654536 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 501/1001] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:32 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:32.870704 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:32.871667 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:32.898333 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:32.901295 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:32.902248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:32.905744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:33.109471 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:33.119415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-984dfe7e-8f25-4cc5-9a06-a188f3242a33 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.252952 May 11 21:13:33.122571 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 501/1002] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:32 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:33.130390 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-0f4df21c-42f9-4c9a-bef7-3afd69e0f03d req-d37db6ce-7c92-476d-a626-77dca621b170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69317df-5298-4b77-bd58-e2284db8656c", "name": "network-vif-plugged", "status": "completed", "tag": "a75fd384-059f-48a9-8646-474738a13496"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:33.139073 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-0f4df21c-42f9-4c9a-bef7-3afd69e0f03d req-d37db6ce-7c92-476d-a626-77dca621b170 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:33.139787 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-0f4df21c-42f9-4c9a-bef7-3afd69e0f03d req-d37db6ce-7c92-476d-a626-77dca621b170 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:33.152105 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-0f4df21c-42f9-4c9a-bef7-3afd69e0f03d req-d37db6ce-7c92-476d-a626-77dca621b170 service nova] Creating event network-vif-plugged:a75fd384-059f-48a9-8646-474738a13496 for instance f69317df-5298-4b77-bd58-e2284db8656c on hv-cinder-84146 May 11 21:13:33.157286 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-0f4df21c-42f9-4c9a-bef7-3afd69e0f03d req-d37db6ce-7c92-476d-a626-77dca621b170 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040489 May 11 21:13:33.158782 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 502/1003] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:33.285500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-6e44b883-f47f-418c-b1eb-91a59c480428 req-b7713462-894c-43e6-b2d6-459d1a4146ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73f6c6a-d23d-42bc-b42c-1dc580fef95c", "tag": "99ecc292-71b0-4268-a0ea-f4af52d014c9"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:33.300142 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-6e44b883-f47f-418c-b1eb-91a59c480428 req-b7713462-894c-43e6-b2d6-459d1a4146ab service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:33.300788 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-6e44b883-f47f-418c-b1eb-91a59c480428 req-b7713462-894c-43e6-b2d6-459d1a4146ab service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:33.313407 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-6e44b883-f47f-418c-b1eb-91a59c480428 req-b7713462-894c-43e6-b2d6-459d1a4146ab service nova] Creating event network-changed:99ecc292-71b0-4268-a0ea-f4af52d014c9 for instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c on hv-cinder-84146 May 11 21:13:33.318985 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-6e44b883-f47f-418c-b1eb-91a59c480428 req-b7713462-894c-43e6-b2d6-459d1a4146ab service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048201 May 11 21:13:33.319953 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 502/1004] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:33.347935 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:33.348676 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:33.356051 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:33.356504 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:33.357287 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:33.357760 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:33.642619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:33.650649 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a81ccb9d-b3a2-48be-9ae9-f6c46d3aa5f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.322261 May 11 21:13:33.651324 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 503/1005] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:33 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:33.671425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:33.672119 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:33.678792 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:33.679243 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:33.680113 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:33.680512 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:33.814551 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:33.822055 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b1f2e6f9-0fc5-4b97-a8a2-00fa3aeede48 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.154583 May 11 21:13:33.822619 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 503/1006] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:33 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:34.136084 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:34.136715 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:34.142521 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:34.142966 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:34.143716 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:34.144146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:34.269069 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:34.276310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-589245ab-580c-41d6-8273-bf0d96f62cde tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1358 microversion: 2.1 time: 0.144100 May 11 21:13:34.276875 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 504/1007] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:34 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:34.667396 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:34.668114 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:34.675040 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:34.675718 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:34.676661 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:34.677103 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:34.839105 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:34.839352 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:34.840052 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:34.854535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:34.854535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:34.854535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:34.854535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:34.855038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-9c2affea-7841-4172-b51e-ad61893e60a9 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.187224 May 11 21:13:34.855038 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 504/1008] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:34 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:35.021123 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:35.028793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-68edf6ad-6f97-4363-a508-a69bedaf04d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.193621 May 11 21:13:35.029353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 505/1009] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:34 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:35.174133 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-94c4d17a-af2a-422e-8396-a90bcbd79110 req-08fc3b65-9b68-4da8-9721-489565539909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc", "name": "network-vif-plugged", "status": "completed", "tag": "0b2017db-bd51-45f0-bb5b-b3407bb05753"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:35.181898 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-94c4d17a-af2a-422e-8396-a90bcbd79110 req-08fc3b65-9b68-4da8-9721-489565539909 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.182342 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-94c4d17a-af2a-422e-8396-a90bcbd79110 req-08fc3b65-9b68-4da8-9721-489565539909 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.196577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-94c4d17a-af2a-422e-8396-a90bcbd79110 req-08fc3b65-9b68-4da8-9721-489565539909 service nova] Creating event network-vif-plugged:0b2017db-bd51-45f0-bb5b-b3407bb05753 for instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc on hv-cinder-84146 May 11 21:13:35.210879 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-94c4d17a-af2a-422e-8396-a90bcbd79110 req-08fc3b65-9b68-4da8-9721-489565539909 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040816 May 11 21:13:35.211496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 505/1010] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:35.294108 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:35.294826 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:35.301297 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.301839 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.302724 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.303277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.434884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:35.442814 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b1c3a0ce-e443-45a7-9bed-1c42dd5d81f9 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1547 microversion: 2.1 time: 0.152624 May 11 21:13:35.443570 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 506/1011] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:35 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:35.462801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:35.462801 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:35.468867 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.469740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.471027 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.471496 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.598632 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:35.606196 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f4cee222-5a9e-4d0b-8340-95904484a9de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1547 microversion: 2.1 time: 0.149961 May 11 21:13:35.606756 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 506/1012] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:35 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:35.622388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:35.625879 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:35.626665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Searching by: {'deleted': False, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56'} {{(pid=117611) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 11 21:13:35.633122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.633488 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.634309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.634740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.730202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.multi_cell_list [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117611) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 11 21:13:35.822807 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-56c89b09-e77e-4649-8d94-4e087cbd22d1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204035 May 11 21:13:35.823382 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 507/1013] 10.222.0.35 () {58 vars in 1124 bytes} [Wed May 11 21:13:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:35.836587 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:35.837205 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:35.843912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.846791 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.847682 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.848202 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.867784 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:35.868467 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:35.875100 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.875556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.876341 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:35.876914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:35.983163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:35.993025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e1497734-e91c-4791-9ee4-2bc58955822e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1547 microversion: 2.1 time: 0.163188 May 11 21:13:35.994102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 507/1014] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:35 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:36.045500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:36.046138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:36.055974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:36.056690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:36.057794 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:36.058588 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:36.194080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:36.204433 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-25e9a381-8256-4934-a14a-6f3aac9c7193 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.340503 May 11 21:13:36.205978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 508/1015] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:35 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:36.221837 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:36.229777 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ea66f792-bc3d-48b9-bf59-691faf1db5a6 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.188027 May 11 21:13:36.230339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 508/1016] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:36 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:37.222095 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:37.222686 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:37.229086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:37.229566 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:37.230335 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:37.230804 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:37.246069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:37.246800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:37.252907 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:37.253352 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:37.254155 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:37.254586 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:37.395254 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:37.403844 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-bd2e2072-8957-449f-b2da-dbd9ceb66801 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1319 microversion: 2.1 time: 0.186292 May 11 21:13:37.404412 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 509/1017] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:37 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:37.415554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:37.420502 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ac0fa244-af7c-4466-98b6-7ab42be9b23f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.178336 May 11 21:13:37.421069 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 509/1018] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:37 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:37.830530 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5468f31a-d350-46ea-bc34-63fa9d8904e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecc5fca3-2d46-4c1a-9f13-de7180240d28"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:37.831610 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5468f31a-d350-46ea-bc34-63fa9d8904e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:37.837773 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5468f31a-d350-46ea-bc34-63fa9d8904e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:37.838228 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5468f31a-d350-46ea-bc34-63fa9d8904e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:37.839000 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5468f31a-d350-46ea-bc34-63fa9d8904e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:37.839458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5468f31a-d350-46ea-bc34-63fa9d8904e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:38.421591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:38.422268 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:38.429147 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:38.429623 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:38.430389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:38.430829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:38.557015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:38.564340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-93193caf-877f-4f9b-b581-378d399f59f0 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1507 microversion: 2.1 time: 0.146649 May 11 21:13:38.564945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 510/1019] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:38 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:13:38.569434 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:38.570062 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:38.575697 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:38.576144 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:38.576939 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:38.577419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:38.658271 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5468f31a-d350-46ea-bc34-63fa9d8904e3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831548 May 11 21:13:38.659070 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 510/1020] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:13:37 2022] POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:38.675798 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5dcc5d21-83cf-4e74-a0c6-b619f36347f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6c771cb-c1bc-43e9-8d2a-5a291ff9c8aa", "device": "/dev/sdb"}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:38.677144 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5dcc5d21-83cf-4e74-a0c6-b619f36347f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:38.684420 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dcc5d21-83cf-4e74-a0c6-b619f36347f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:38.684868 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dcc5d21-83cf-4e74-a0c6-b619f36347f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:38.685807 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dcc5d21-83cf-4e74-a0c6-b619f36347f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:38.687422 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5dcc5d21-83cf-4e74-a0c6-b619f36347f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:38.738248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:38.746474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fac0c0dd-c1fb-407d-a3cc-2b1e19437a01 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.180551 May 11 21:13:38.747415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 511/1021] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:38 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:39.543505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5dcc5d21-83cf-4e74-a0c6-b619f36347f7 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "POST /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.882766 May 11 21:13:39.544117 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 511/1022] 10.222.0.35 () {60 vars in 1322 bytes} [Wed May 11 21:13:38 2022] POST /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:39.764062 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:39.764665 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:39.770863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:39.776470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:39.776470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:39.776470 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:39.903832 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:39.911834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f700ede7-60b7-460c-9c77-6b174c805004 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.151520 May 11 21:13:39.912408 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 512/1023] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:39 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:40.930171 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:40.930953 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:40.937346 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:40.941660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:40.941660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:40.941660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:41.222712 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:41.229992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2767c71d-0461-42fe-aa4c-0ae31e73ce3a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.304501 May 11 21:13:41.230556 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 512/1024] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:40 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:42.246576 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:42.247802 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:42.254473 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:42.254913 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:42.255925 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:42.256424 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:42.404037 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:42.413725 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2bdef110-1256-4b1f-a35f-82bf50f9292a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.170945 May 11 21:13:42.425633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 513/1025] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:42 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:43.431881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:43.432486 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:43.439010 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:43.439451 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:43.440487 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:43.441128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:43.655188 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:43.663533 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-afef7483-bf43-4b2c-b37c-0099cc6efd3b tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.236269 May 11 21:13:43.664305 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 513/1026] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:43 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:44.682954 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:44.683860 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:44.692421 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:44.692879 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:44.693781 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:44.694117 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:44.877405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:44.885625 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-54713243-f720-43cf-9927-0e0ebbb177d4 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.208779 May 11 21:13:44.888072 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 514/1027] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:44 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:45.144372 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-0d430139-e66f-4f8d-89d3-577ee42eef9a req-41855fdd-f234-4286-8cbc-1c337d6c4fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73f6c6a-d23d-42bc-b42c-1dc580fef95c", "name": "network-vif-plugged", "status": "completed", "tag": "99ecc292-71b0-4268-a0ea-f4af52d014c9"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:45.154413 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-0d430139-e66f-4f8d-89d3-577ee42eef9a req-41855fdd-f234-4286-8cbc-1c337d6c4fa1 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:45.154859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-0d430139-e66f-4f8d-89d3-577ee42eef9a req-41855fdd-f234-4286-8cbc-1c337d6c4fa1 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:45.168492 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-0d430139-e66f-4f8d-89d3-577ee42eef9a req-41855fdd-f234-4286-8cbc-1c337d6c4fa1 service nova] Creating event network-vif-plugged:99ecc292-71b0-4268-a0ea-f4af52d014c9 for instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c on hv-cinder-84146 May 11 21:13:45.173689 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-0d430139-e66f-4f8d-89d3-577ee42eef9a req-41855fdd-f234-4286-8cbc-1c337d6c4fa1 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033516 May 11 21:13:45.174273 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 514/1028] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:45.912679 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:45.913279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:45.927371 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:45.927820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:45.928793 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:45.929384 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:46.072555 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:46.079913 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-b0bbb578-aa64-40fd-973d-4987d1576996 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.171059 May 11 21:13:46.080484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 515/1029] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:45 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:46.275142 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:46.276087 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:46.283896 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:46.284400 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:46.285462 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:46.286124 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:46.431905 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:46.440280 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c2aca3aa-d39d-4175-b87d-78b42bad5638 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1593 microversion: 2.1 time: 0.169890 May 11 21:13:46.440866 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 515/1030] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:46 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1593 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:47.098275 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:47.098903 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:47.109681 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:47.112432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:47.115460 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:47.116113 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:47.440849 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:47.451792 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-6d5b17c6-bfe7-4cfe-93bc-053b02035bd1 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1265 microversion: 2.1 time: 0.359172 May 11 21:13:47.452403 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 516/1031] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:47 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:48.475946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:48.475946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:48.481919 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:48.482584 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:48.483613 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:48.484223 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:48.765639 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:48.774281 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a5850f88-5fda-4f97-91a6-0af44c66d299 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1452 microversion: 2.1 time: 0.306925 May 11 21:13:48.779789 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 516/1032] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:48 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1452 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:48.796644 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:48.798711 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:48.809722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:48.812514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:48.812514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:48.812514 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:49.053876 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:49.061171 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8fa29056-1c4c-47f4-8c46-eef10387c739 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1452 microversion: 2.1 time: 0.268453 May 11 21:13:49.061888 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 517/1033] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:48 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1452 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:13:50.152630 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-becae56b-0a69-4c94-92d5-ecec062e7b58 req-0587460e-45c4-42d5-ba11-be2e70033d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69317df-5298-4b77-bd58-e2284db8656c", "tag": "a75fd384-059f-48a9-8646-474738a13496"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:50.169478 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-becae56b-0a69-4c94-92d5-ecec062e7b58 req-0587460e-45c4-42d5-ba11-be2e70033d44 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:50.169951 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-becae56b-0a69-4c94-92d5-ecec062e7b58 req-0587460e-45c4-42d5-ba11-be2e70033d44 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:50.194201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-becae56b-0a69-4c94-92d5-ecec062e7b58 req-0587460e-45c4-42d5-ba11-be2e70033d44 service nova] Creating event network-changed:a75fd384-059f-48a9-8646-474738a13496 for instance f69317df-5298-4b77-bd58-e2284db8656c on hv-cinder-84146 May 11 21:13:50.201809 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-becae56b-0a69-4c94-92d5-ecec062e7b58 req-0587460e-45c4-42d5-ba11-be2e70033d44 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052786 May 11 21:13:50.202419 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 517/1034] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:52.524642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-10db41c3-3d04-437b-9e58-9d7e9c3daedb req-624fa7ef-fa13-489d-8ca4-1f76d989cf6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73f6c6a-d23d-42bc-b42c-1dc580fef95c", "tag": "99ecc292-71b0-4268-a0ea-f4af52d014c9"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:52.537570 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-10db41c3-3d04-437b-9e58-9d7e9c3daedb req-624fa7ef-fa13-489d-8ca4-1f76d989cf6d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:52.538269 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-10db41c3-3d04-437b-9e58-9d7e9c3daedb req-624fa7ef-fa13-489d-8ca4-1f76d989cf6d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:52.550495 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-10db41c3-3d04-437b-9e58-9d7e9c3daedb req-624fa7ef-fa13-489d-8ca4-1f76d989cf6d service nova] Creating event network-changed:99ecc292-71b0-4268-a0ea-f4af52d014c9 for instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c on hv-cinder-84146 May 11 21:13:52.564116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-10db41c3-3d04-437b-9e58-9d7e9c3daedb req-624fa7ef-fa13-489d-8ca4-1f76d989cf6d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043357 May 11 21:13:52.572315 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 518/1035] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:53.053884 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2fed5ec4-5355-4443-b6e7-828243ac0aa5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Action: 'create', calling method: .version_select at 0x7ff89278c040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1370924965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC60nstCznBkFNflM0Sn1UlhnfbQqwyYo7BpMAL5OWAC9Id6gRjDqXz/z4XZ0NE9p6zvyFv3+1Cp1hQx6gToSx/yCcw8qxjkw+cO9XDAKpUJB400refZwL93VcmTNSjFvg=="}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:53.085094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-2fed5ec4-5355-4443-b6e7-828243ac0aa5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Getting quotas for project 715fee0f9c6e4c73b716faa3b978208c. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:13:53.093058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.quota [None req-2fed5ec4-5355-4443-b6e7-828243ac0aa5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Getting quotas for user 05901232e0534f6fa130e78584b703ee and project 715fee0f9c6e4c73b716faa3b978208c. Resources: {'key_pairs'} {{(pid=117611) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:13:53.233040 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2fed5ec4-5355-4443-b6e7-828243ac0aa5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.477916 May 11 21:13:53.234317 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 518/1036] 10.222.0.35 () {60 vars in 1158 bytes} [Wed May 11 21:13:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:13:53.536647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1467761671"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:53.537955 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:53.545248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:53.545931 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:53.546909 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:53.547571 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:53.689952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.network.security_group_api [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Adding security group 0474b137-bb9f-4219-a273-5236bb2f920f to port a75fd384-059f-48a9-8646-474738a13496 May 11 21:13:54.438000 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bf434ede-63ba-409d-87db-5e34fe927015 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/action" status: 202 len: 0 microversion: 2.1 time: 0.906992 May 11 21:13:54.439096 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 519/1037] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:13:53 2022] POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:13:54.448434 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:13:54.449108 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:13:54.457456 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:54.457991 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:54.458767 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:54.459203 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:54.593137 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-38abd7ea-7545-4026-a2d9-e8258bb0d0be req-a5427354-27e4-4356-8a7a-37980516b2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69317df-5298-4b77-bd58-e2284db8656c", "tag": "a75fd384-059f-48a9-8646-474738a13496"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:13:54.600987 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-38abd7ea-7545-4026-a2d9-e8258bb0d0be req-a5427354-27e4-4356-8a7a-37980516b2f6 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:13:54.601671 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-38abd7ea-7545-4026-a2d9-e8258bb0d0be req-a5427354-27e4-4356-8a7a-37980516b2f6 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:13:54.627483 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-38abd7ea-7545-4026-a2d9-e8258bb0d0be req-a5427354-27e4-4356-8a7a-37980516b2f6 service nova] Creating event network-changed:a75fd384-059f-48a9-8646-474738a13496 for instance f69317df-5298-4b77-bd58-e2284db8656c on hv-cinder-84146 May 11 21:13:54.641098 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-38abd7ea-7545-4026-a2d9-e8258bb0d0be req-a5427354-27e4-4356-8a7a-37980516b2f6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052488 May 11 21:13:54.644975 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 520/1038] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:13:54.655245 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:13:54.665952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-5de50945-8c14-4b47-a8e4-467b897e0044 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1759 microversion: 2.1 time: 0.222292 May 11 21:13:54.670416 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 519/1039] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:13:54 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1759 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:05.957685 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:05.958264 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:05.964290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:05.964734 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:05.965484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:05.965977 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:06.043795 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lazy-loading 'services' on Instance uuid 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:14:06.295713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-584c0a58-1338-44fe-80b1-e8afc408fb2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc/os-volume_attachments/f6c771cb-c1bc-43e9-8d2a-5a291ff9c8aa" status: 202 len: 0 microversion: 2.1 time: 0.343091 May 11 21:14:06.296310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 521/1040] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:14:05 2022] DELETE /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc/os-volume_attachments/f6c771cb-c1bc-43e9-8d2a-5a291ff9c8aa => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:14:08.461891 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:08.462510 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:08.469336 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:08.469815 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:08.470591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:08.471028 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:08.495757 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:14:08.784787 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b5963c5f-302e-4496-8931-3b6e5cdec20d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "DELETE /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 204 len: 0 microversion: 2.1 time: 0.326329 May 11 21:14:08.785483 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 520/1041] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:14:08 2022] DELETE /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:14:08.794509 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:08.795272 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:08.801394 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:08.801873 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:08.802637 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:08.803073 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:08.932214 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:08.940259 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2c72938e-6a4e-454b-b02e-cc7f26669097 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1513 microversion: 2.1 time: 0.150401 May 11 21:14:08.940824 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 522/1042] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:08 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:09.958165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:09.958863 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:09.965261 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:09.965748 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:09.966514 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:09.966953 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:10.096432 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:10.103634 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-37f2a5ab-af78-4012-968b-685425f4ba0d tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1513 microversion: 2.1 time: 0.149780 May 11 21:14:10.104200 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 521/1043] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:09 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:11.121578 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:11.122157 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:11.129267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:11.129740 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:11.130515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:11.130947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:11.260900 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:11.268195 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-808076d2-b7e5-48f9-9649-6812afe49e2b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1513 microversion: 2.1 time: 0.150680 May 11 21:14:11.268838 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 523/1044] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:11 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:11.519545 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-5d444c07-cb2a-4051-8752-84d3fe804bca req-10382a55-f0c1-4e52-839e-239a80e92b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc", "name": "network-vif-deleted", "tag": "0b2017db-bd51-45f0-bb5b-b3407bb05753"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:14:11.528803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5d444c07-cb2a-4051-8752-84d3fe804bca req-10382a55-f0c1-4e52-839e-239a80e92b5d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:11.529246 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-5d444c07-cb2a-4051-8752-84d3fe804bca req-10382a55-f0c1-4e52-839e-239a80e92b5d service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:11.540004 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-5d444c07-cb2a-4051-8752-84d3fe804bca req-10382a55-f0c1-4e52-839e-239a80e92b5d service nova] Creating event network-vif-deleted:0b2017db-bd51-45f0-bb5b-b3407bb05753 for instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc on hv-cinder-84146 May 11 21:14:11.548674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-5d444c07-cb2a-4051-8752-84d3fe804bca req-10382a55-f0c1-4e52-839e-239a80e92b5d service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033912 May 11 21:14:11.549248 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 522/1045] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:14:12.285166 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:12.286340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:12.292631 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:12.293080 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:12.293908 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:12.294335 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:12.324874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:12.325279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:12.325763 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lazy-loading 'fault' on Instance uuid 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:14:12.366819 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98cd883e05da4e5798ad64e7a43bfed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37271fa94bf4dd7b16f144dbb9c049c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:12.375141 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8fd0257e-faca-4e19-8040-aa35d620ea34 tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 200 len: 1309 microversion: 2.1 time: 0.093038 May 11 21:14:12.375141 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 524/1046] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:12 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:13.393136 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:13.393956 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] [instance: 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:13.400471 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:13.400916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:13.401705 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:13.402178 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:13.416425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] HTTP exception thrown: Instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc could not be found. May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Request method failure captured: May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc HTTP/1.1 May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCaWKMY2WKZtXLHNwFJfxQIdD59_X8RxuH4deGsdmNxlJ_nssJKzUpVZBYah6Rk-cV16E3RLb1AUzgf6OGrFuhJWRxyuv64tdkjLWPDSBDPuoggtGf-qgpLE5K-hLQ9TpI_1NPewlhEU-bxGV5lDl2Dg9nFzWpk5p24cpw99o7GyfUM May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: b37271fa94bf4dd7b16f144dbb9c049c May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-VolumesSnapshotTestJSON-257129253 May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:14:13.418113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/b37271fa94bf4dd7b16f144dbb9c049c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-VolumesSnapshotTestJSON-257129253 May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: b37271fa94bf4dd7b16f144dbb9c049c May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-257129253 May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-VolumesSnapshotTestJSON-257129253-project May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 98cd883e05da4e5798ad64e7a43bfed1 May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-VolumesSnapshotTestJSON-257129253-project May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc could not be found. May 11 21:14:13.419655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc'} May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc could not be found. May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:14:13.421265 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc could not be found. May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc could not be found. May 11 21:14:13.423113 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:14:13.425145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] Returning 404 to user: Instance 3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:14:13.425145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-39606ba5-6ec8-46af-b19a-e6ca58747c8b tempest-VolumesSnapshotTestJSON-257129253 tempest-VolumesSnapshotTestJSON-257129253-project] 10.222.0.35 "GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc" status: 404 len: 111 microversion: 2.1 time: 0.031007 May 11 21:14:13.425145 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 523/1047] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:13 2022] GET /compute/v2.1/servers/3fac6611-f9f3-4dd2-9d1c-15c99c9e2ebc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:14:13.472425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2095676333", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1370924965", "security_groups": [{"name": "tempest-secgroup-smoke-930424615"}], "networks": [{"uuid": "d6869d34-bf63-4e4e-9ffe-81f61871d221"}], "block_device_mapping_v2": [{"uuid": "71bbbf9f-61e9-4372-bd42-18d2a067c166", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:14:13.581251 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.network.neutron [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] validate_networks() for [('d6869d34-bf63-4e4e-9ffe-81f61871d221', None, None, None, None, None)] {{(pid=117612) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 21:14:13.944936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Flavor limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 21:14:13.945393 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Image limits 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 21:14:13.945897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Flavor pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 21:14:13.946382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Image pref 0:0:0 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 21:14:13.946731 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.virt.hardware [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117612) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 21:14:13.955421 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:13.955869 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:13.956668 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:13.957102 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:13.972972 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Getting quotas for project 715fee0f9c6e4c73b716faa3b978208c. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 21:14:13.976857 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.quota [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Getting quotas for user 05901232e0534f6fa130e78584b703ee and project 715fee0f9c6e4c73b716faa3b978208c. Resources: {'instances', 'cores', 'ram'} {{(pid=117612) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 21:14:14.037516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Going to run 1 instances... {{(pid=117612) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 21:14:14.039926 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71bbbf9f-61e9-4372-bd42-18d2a067c166',volume_size=None,volume_type=None)] {{(pid=117612) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 21:14:14.471415 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-26777905-216a-4a4c-8571-04f872078d3d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.002729 May 11 21:14:14.472055 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 525/1048] 10.222.0.35 () {60 vars in 1146 bytes} [Wed May 11 21:14:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 21:14:14.483218 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-00f8d8d5-cdd4-42a8-b0d4-43c5856ec0b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:14.483855 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-00f8d8d5-cdd4-42a8-b0d4-43c5856ec0b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:14.537983 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-00f8d8d5-cdd4-42a8-b0d4-43c5856ec0b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:14.544603 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-00f8d8d5-cdd4-42a8-b0d4-43c5856ec0b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1089 microversion: 2.1 time: 0.066080 May 11 21:14:14.545165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 524/1049] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:14 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:15.562722 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:15.563340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:15.570537 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:15.571036 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:15.571812 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:15.572252 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:15.635324 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:15.642831 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-47e9a83f-e142-4e16-9664-1824fb5c57b4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1139 microversion: 2.1 time: 0.084462 May 11 21:14:15.643389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 526/1050] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:15 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:16.659684 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:16.660294 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:16.667322 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:16.667774 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:16.668534 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:16.668967 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:16.726604 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:16.733700 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-94ef574f-38f6-4b30-97ae-38b3eb6fedb5 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1131 microversion: 2.1 time: 0.077794 May 11 21:14:16.734251 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 525/1051] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:16 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1131 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:17.750914 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:17.751478 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:17.758451 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:17.758892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:17.759660 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:17.760116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:17.821047 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:17.828481 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e56d4209-4676-4e38-9e2d-8345eaba5e52 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1131 microversion: 2.1 time: 0.081466 May 11 21:14:17.829089 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 527/1052] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:17 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1131 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:18.846572 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:18.846572 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:18.852374 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:18.852827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:18.853655 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:18.854096 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:18.916793 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:18.924257 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4805cea4-6218-4f7b-8966-3952e95c9168 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1187 microversion: 2.1 time: 0.082889 May 11 21:14:18.924820 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 526/1053] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:18 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:19.940258 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:19.941462 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:19.949210 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:19.949720 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:19.950744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:19.951182 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:20.104004 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:20.111642 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ad4f8ac1-3093-447f-a145-5c7b8d099dda tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1272 microversion: 2.1 time: 0.175311 May 11 21:14:20.112212 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 528/1054] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:19 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:20.849953 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-e6ac3a9c-bae8-4307-b197-bde48850a04f req-a596655a-7e0c-49c1-b01c-29133474bbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039766c9-0b97-4a35-ad0e-e319d594de7b", "tag": "2c41fccc-aa6b-401a-ada6-e084b87e786b"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:14:20.858099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e6ac3a9c-bae8-4307-b197-bde48850a04f req-a596655a-7e0c-49c1-b01c-29133474bbe3 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:20.858988 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-e6ac3a9c-bae8-4307-b197-bde48850a04f req-a596655a-7e0c-49c1-b01c-29133474bbe3 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:20.871904 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-e6ac3a9c-bae8-4307-b197-bde48850a04f req-a596655a-7e0c-49c1-b01c-29133474bbe3 service nova] Creating event network-changed:2c41fccc-aa6b-401a-ada6-e084b87e786b for instance 039766c9-0b97-4a35-ad0e-e319d594de7b on hv-cinder-84146 May 11 21:14:20.876821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-e6ac3a9c-bae8-4307-b197-bde48850a04f req-a596655a-7e0c-49c1-b01c-29133474bbe3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032627 May 11 21:14:20.877430 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 527/1055] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:14:21.135715 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:21.136291 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:21.142270 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:21.142720 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:21.143489 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:21.143922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:21.289216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:21.296609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8bf98613-fb55-4898-91b3-684454651f09 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.164829 May 11 21:14:21.297171 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 529/1056] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:21 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:22.314725 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:22.315423 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:22.322638 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:22.323089 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:22.323853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:22.324292 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:22.452234 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:22.459990 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-466e8dc7-d323-418b-adb2-6d64bf76b903 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.149456 May 11 21:14:22.460576 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 528/1057] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:22 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:23.477209 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:23.477791 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:23.484246 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:23.484694 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:23.485461 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:23.485924 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:23.613887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:23.621922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4b8036ed-fade-44a7-ba23-8ac371b9e3b3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.149155 May 11 21:14:23.622484 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 530/1058] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:23 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:24.638714 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:24.639313 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:24.645599 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:24.646053 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:24.646828 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:24.647436 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:24.775923 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:24.783364 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c36a5b65-fb44-4823-8ec7-69f0787b6a80 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.148518 May 11 21:14:24.783926 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 529/1059] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:24 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:25.000338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e61cf3f7-6fce-487c-ad4e-b093716f6e1d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:14:25.001356 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e61cf3f7-6fce-487c-ad4e-b093716f6e1d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:25.007582 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e61cf3f7-6fce-487c-ad4e-b093716f6e1d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:25.008022 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e61cf3f7-6fce-487c-ad4e-b093716f6e1d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:25.008773 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e61cf3f7-6fce-487c-ad4e-b093716f6e1d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:25.009204 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e61cf3f7-6fce-487c-ad4e-b093716f6e1d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:25.268274 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e61cf3f7-6fce-487c-ad4e-b093716f6e1d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/action" status: 202 len: 0 microversion: 2.1 time: 0.271597 May 11 21:14:25.268822 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 531/1060] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:14:24 2022] POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:14:25.277226 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:25.277945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:25.283894 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:25.284358 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:25.285142 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:25.285604 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:25.432549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:25.440535 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e8b77652-c7c2-4af5-b9c1-f2cb86461166 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1751 microversion: 2.1 time: 0.167052 May 11 21:14:25.441100 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 530/1061] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:25 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:25.801423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:25.802163 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:25.808294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:25.808744 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:25.809505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:25.809974 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:25.935906 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:25.943734 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-44c39997-bff3-4e1c-81e1-75ff9a600e0d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.146049 May 11 21:14:25.944295 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 532/1062] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:25 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:26.457715 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:26.458331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:26.464660 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:26.465114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:26.465908 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:26.466349 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:26.607057 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:26.615526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6e062525-658e-4077-aa14-35b1167b0653 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1751 microversion: 2.1 time: 0.161067 May 11 21:14:26.616094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 531/1063] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:26 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:26.960663 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:26.961283 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:26.967676 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:26.968129 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:26.968896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:26.969332 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:27.100780 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:27.108060 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e7de84f5-cbe3-4d11-b7fa-dc8e9597685e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.151753 May 11 21:14:27.108622 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 533/1064] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:26 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:27.633166 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:27.633817 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:27.640214 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:27.640665 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:27.641425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:27.641890 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:27.778720 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:27.786421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-634f335e-79d7-4433-8f2e-0c36afe7520a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1751 microversion: 2.1 time: 0.157743 May 11 21:14:27.787510 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 532/1065] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:27 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:28.124150 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:28.124814 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:28.130953 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:28.136881 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:28.136881 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:28.136881 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:28.258690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:28.266071 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a28d8542-ceb9-4b36-b240-a32c1eca93c6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.145744 May 11 21:14:28.268569 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 534/1066] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:28 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:28.803466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:28.804067 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:28.810428 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:28.810918 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:28.811680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:28.812112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:28.953799 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:28.961653 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b57bfa9a-6e08-430a-b433-b15ca89c9935 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1751 microversion: 2.1 time: 0.162038 May 11 21:14:28.962234 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 533/1067] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:28 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:29.284346 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:29.284988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:29.291978 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:29.292423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:29.293184 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:29.293652 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:29.424824 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:29.432930 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-35ef4f81-f2f8-410c-b84c-903a1458c817 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.152707 May 11 21:14:29.433490 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 535/1068] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:29 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:14:29.979472 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:29.980076 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:29.986359 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:29.986804 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:29.987558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:29.987985 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:30.128992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:30.137282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ea8dfa74-9111-4edf-af77-d643d4ee8c0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.161672 May 11 21:14:30.137861 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 534/1069] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:29 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:30.449887 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:30.452957 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:30.457310 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:30.457794 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:30.458560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:30.458991 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:30.590351 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:30.600679 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-930b5155-0608-4560-a45c-ab127abd571e tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.154944 May 11 21:14:30.601252 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 536/1070] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:30 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:31.155542 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:31.156178 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:31.163138 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:31.163587 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:31.164383 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:31.164819 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:31.299935 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:31.307702 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-b8965ecf-ee2e-41e7-8f19-b9dff3da1d7b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.156276 May 11 21:14:31.308283 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 535/1071] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:31 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:31.617359 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:31.618008 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:31.624273 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:31.624713 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:31.625467 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:31.625918 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:31.760376 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:31.767608 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8a220762-59f5-4016-a70e-32948f93290b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.154148 May 11 21:14:31.768170 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 537/1072] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:31 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:32.324237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:32.324852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:32.331109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:32.331589 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:32.332367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:32.332807 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:32.417128 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-9a2c719a-7f73-4fa9-b53e-755fe060b1d9 req-4f123bab-9d30-4a9d-bf16-b50c25d7c8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039766c9-0b97-4a35-ad0e-e319d594de7b", "name": "network-vif-plugged", "status": "completed", "tag": "2c41fccc-aa6b-401a-ada6-e084b87e786b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:14:32.425304 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9a2c719a-7f73-4fa9-b53e-755fe060b1d9 req-4f123bab-9d30-4a9d-bf16-b50c25d7c8a6 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:32.425777 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-9a2c719a-7f73-4fa9-b53e-755fe060b1d9 req-4f123bab-9d30-4a9d-bf16-b50c25d7c8a6 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:32.437210 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-9a2c719a-7f73-4fa9-b53e-755fe060b1d9 req-4f123bab-9d30-4a9d-bf16-b50c25d7c8a6 service nova] Creating event network-vif-plugged:2c41fccc-aa6b-401a-ada6-e084b87e786b for instance 039766c9-0b97-4a35-ad0e-e319d594de7b on hv-cinder-84146 May 11 21:14:32.442232 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-9a2c719a-7f73-4fa9-b53e-755fe060b1d9 req-4f123bab-9d30-4a9d-bf16-b50c25d7c8a6 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029144 May 11 21:14:32.442863 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 538/1073] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:14:32.478500 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:32.486520 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a1ca98a9-dfa3-44bc-b5b1-caa79f28263e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.166222 May 11 21:14:32.487089 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 536/1074] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:32 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:32.786179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:32.788762 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:32.793512 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:32.793994 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:32.794771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:32.795221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:32.926419 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:32.933617 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-e3d0f447-5ef5-4a5f-a560-1868347f9a37 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.152314 May 11 21:14:32.934169 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 539/1075] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:32 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:33.503982 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:33.504580 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:33.511399 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:33.511825 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:33.512580 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:33.513011 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:33.654146 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:33.661865 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c0e09c64-fb6b-4025-8a81-1957a1feac9f tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.161713 May 11 21:14:33.662424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 537/1076] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:33 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:33.950560 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:33.952687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:33.957228 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:33.957721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:33.958495 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:33.959132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:34.090116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:34.097425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d376bf38-ed8b-4db4-b386-3d28afb4b5bc tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1260 microversion: 2.1 time: 0.151734 May 11 21:14:34.098009 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 540/1077] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:33 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:34.678915 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:34.679524 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:34.685754 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:34.686195 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:34.686945 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:34.687374 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:34.824812 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:34.832721 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-cefb61e5-51f5-42fc-8d68-85b87f3392b7 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.157639 May 11 21:14:34.833216 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 538/1078] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:34 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:35.114366 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:35.115506 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:35.121796 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:35.122249 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:35.123021 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:35.123505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:35.260824 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:35.271243 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f9e5b891-77a7-4b04-805a-3a4407d3b0e4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1443 microversion: 2.1 time: 0.160617 May 11 21:14:35.271843 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 541/1079] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:35 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:35.294251 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:35.294859 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:35.300669 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:35.301114 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:35.301976 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:35.303061 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:35.431312 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:35.438955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c29ccf02-f7b1-4248-aec5-f73dcb3ffdf4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1443 microversion: 2.1 time: 0.148644 May 11 21:14:35.439558 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 539/1080] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:35 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:35.852971 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:35.853591 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:35.859505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:35.859942 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:35.860707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:35.861141 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:36.001049 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:36.009449 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3f01dc03-5cd8-481d-9deb-cc5ea41c2d71 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.161077 May 11 21:14:36.010054 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 542/1081] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:35 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:37.026631 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:37.027323 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:37.033853 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:37.041102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:37.041102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:37.041102 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:37.261250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:37.269208 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-2abf293c-1347-43a9-8213-6d0d37b6da2d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.246497 May 11 21:14:37.270024 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 540/1082] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:37 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:14:37.752492 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-d4150cb6-9a7e-4de5-ba8b-aeaaa0d8a116 req-3058b941-920d-4700-8b3b-3dab63ce83ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039766c9-0b97-4a35-ad0e-e319d594de7b", "tag": "2c41fccc-aa6b-401a-ada6-e084b87e786b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:14:37.761717 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d4150cb6-9a7e-4de5-ba8b-aeaaa0d8a116 req-3058b941-920d-4700-8b3b-3dab63ce83ad service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:37.766391 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-d4150cb6-9a7e-4de5-ba8b-aeaaa0d8a116 req-3058b941-920d-4700-8b3b-3dab63ce83ad service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:37.774404 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-d4150cb6-9a7e-4de5-ba8b-aeaaa0d8a116 req-3058b941-920d-4700-8b3b-3dab63ce83ad service nova] Creating event network-changed:2c41fccc-aa6b-401a-ada6-e084b87e786b for instance 039766c9-0b97-4a35-ad0e-e319d594de7b on hv-cinder-84146 May 11 21:14:37.779947 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-d4150cb6-9a7e-4de5-ba8b-aeaaa0d8a116 req-3058b941-920d-4700-8b3b-3dab63ce83ad service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031174 May 11 21:14:37.780850 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 543/1083] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:14:38.288337 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:38.288992 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:38.295821 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:38.296985 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:38.297978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:38.298432 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:38.446085 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:38.454865 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e6acc8e7-163c-47f6-83d7-f5cee8aa1f0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.171064 May 11 21:14:38.455525 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 541/1084] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:38 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:39.473030 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:39.473755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:39.480611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:39.481054 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:39.481845 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:39.482278 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:39.633364 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:39.641840 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-fb5854c1-2517-48d1-950d-fefcd24ea4bc tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.173284 May 11 21:14:39.642422 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 544/1085] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:39 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:40.659921 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:40.660557 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:40.667589 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:40.668048 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:40.668826 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:40.669285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:40.811532 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:40.819591 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d46a0aec-6695-4cbb-a987-33d7db670def tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.163695 May 11 21:14:40.820401 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 542/1086] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:40 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:41.836609 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:41.837234 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:41.843896 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:41.844423 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:41.845186 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:41.846004 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:41.987891 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:41.995878 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-4287acdc-ff8b-4870-ac94-847900aabed2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.163657 May 11 21:14:41.996505 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 545/1087] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:41 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:43.013119 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:43.013753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:43.020075 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:43.020527 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:43.021288 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:43.021758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:43.164511 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:43.172551 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0dda0ae8-24a3-49de-858d-e8b5afd63f2a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.163240 May 11 21:14:43.173112 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 543/1088] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:43 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:44.189655 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:44.190198 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:44.197299 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:44.197780 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:44.198582 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:44.199022 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:44.340724 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:44.348654 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-d0bd8fbf-24b5-4339-b71a-23227ead9996 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.162957 May 11 21:14:44.353895 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 546/1089] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:44 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:45.366689 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:45.367296 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:45.373299 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:45.376124 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:45.376124 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:45.376124 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:45.512538 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:45.520338 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c98d6c8c-1eb7-4fc8-af0b-e255d382d810 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.158049 May 11 21:14:45.520906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 544/1090] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:45 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:46.537785 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:46.542343 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:46.544546 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:46.545030 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:46.545825 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:46.546267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:46.684239 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:46.692051 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ab3de29f-6293-4e1e-bc17-f7b1d54521e1 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.158309 May 11 21:14:46.692613 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 547/1091] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:46 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:47.709517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:47.710072 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:47.716375 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:47.716832 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:47.717631 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:47.718071 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:48.017251 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:48.025646 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-47d84e39-651c-4ae0-9bb7-5bc6b9077e5d tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.320624 May 11 21:14:48.026200 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 545/1092] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:47 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:49.043340 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:49.043937 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:49.050307 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:49.050755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:49.051517 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:49.051953 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:49.244569 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:49.252208 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-93d1a786-a1b7-4b14-84a8-69312ea7dbb3 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.213183 May 11 21:14:49.252767 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 548/1093] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:49 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:50.269363 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:50.269994 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:50.276217 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:50.276668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:50.277431 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:50.277889 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:50.417914 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:50.425726 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-376309eb-2980-4ab9-8d30-c77826321e88 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.160316 May 11 21:14:50.426284 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 546/1094] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:50 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:51.442892 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:51.443731 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:51.450571 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:51.450823 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:51.451588 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:51.452031 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:51.596567 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:51.604934 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f2f92b22-7e9f-4950-8b04-9a43a46c6d0b tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1756 microversion: 2.1 time: 0.165939 May 11 21:14:51.605488 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 549/1095] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:51 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:14:52.622569 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:14:52.623166 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:14:52.629435 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:52.629916 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:52.630680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:14:52.631116 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:14:52.768152 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:14:52.776331 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f1da0f18-5571-45a4-9341-05f080109b35 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1759 microversion: 2.1 time: 0.158230 May 11 21:14:52.776883 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 547/1096] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:14:52 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1759 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:31.650044 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1467761671"}} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:15:31.650686 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:31.657358 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:31.657844 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:31.658601 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:31.659032 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:31.793577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.network.security_group_api [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Removing security group 0474b137-bb9f-4219-a273-5236bb2f920f from port a75fd384-059f-48a9-8646-474738a13496 May 11 21:15:32.218044 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-92a15ae4-08ac-42a9-8663-9539c8cc41a0 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/action" status: 202 len: 0 microversion: 2.1 time: 0.571456 May 11 21:15:32.223590 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 550/1097] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:15:31 2022] POST /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:15:32.425612 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-fc91f304-968c-4952-897a-bd06f799712b req-69f696dd-34f7-47c6-8ec0-8abcaef4a3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69317df-5298-4b77-bd58-e2284db8656c", "tag": "a75fd384-059f-48a9-8646-474738a13496"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:15:32.435526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fc91f304-968c-4952-897a-bd06f799712b req-69f696dd-34f7-47c6-8ec0-8abcaef4a3a2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:32.435977 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-fc91f304-968c-4952-897a-bd06f799712b req-69f696dd-34f7-47c6-8ec0-8abcaef4a3a2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:32.447164 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-fc91f304-968c-4952-897a-bd06f799712b req-69f696dd-34f7-47c6-8ec0-8abcaef4a3a2 service nova] Creating event network-changed:a75fd384-059f-48a9-8646-474738a13496 for instance f69317df-5298-4b77-bd58-e2284db8656c on hv-cinder-84146 May 11 21:15:32.452856 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-fc91f304-968c-4952-897a-bd06f799712b req-69f696dd-34f7-47c6-8ec0-8abcaef4a3a2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231564 May 11 21:15:32.453425 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 548/1098] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:15:33.391834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:33.392338 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:33.398248 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:33.398692 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:33.399448 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:33.399876 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:33.662940 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lazy-loading 'services' on Instance uuid f69317df-5298-4b77-bd58-e2284db8656c {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:15:33.846135 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-06c45bbc-f095-4c9d-845c-8a8ae063b4de tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments/ecc5fca3-2d46-4c1a-9f13-de7180240d28" status: 202 len: 0 microversion: 2.1 time: 0.459421 May 11 21:15:33.846920 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 551/1099] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:15:33 2022] DELETE /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments/ecc5fca3-2d46-4c1a-9f13-de7180240d28 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:15:33.856411 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c7f4863c-0eec-4c84-bcd9-bf52bd751faa tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:33.858244 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c7f4863c-0eec-4c84-bcd9-bf52bd751faa tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:33.865309 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7f4863c-0eec-4c84-bcd9-bf52bd751faa tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:33.865786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7f4863c-0eec-4c84-bcd9-bf52bd751faa tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:33.866563 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7f4863c-0eec-4c84-bcd9-bf52bd751faa tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:33.867000 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c7f4863c-0eec-4c84-bcd9-bf52bd751faa tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:33.896254 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c7f4863c-0eec-4c84-bcd9-bf52bd751faa tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 May 11 21:15:33.896722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 549/1100] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:15:33 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:15:34.469425 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-677be553-9132-4106-8e42-e85531dce14b req-8721187d-87fb-4325-b417-0d7b4cb8f94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69317df-5298-4b77-bd58-e2284db8656c", "tag": "a75fd384-059f-48a9-8646-474738a13496"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:15:34.478202 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-677be553-9132-4106-8e42-e85531dce14b req-8721187d-87fb-4325-b417-0d7b4cb8f94e service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:34.478648 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-677be553-9132-4106-8e42-e85531dce14b req-8721187d-87fb-4325-b417-0d7b4cb8f94e service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:34.490634 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-677be553-9132-4106-8e42-e85531dce14b req-8721187d-87fb-4325-b417-0d7b4cb8f94e service nova] Creating event network-changed:a75fd384-059f-48a9-8646-474738a13496 for instance f69317df-5298-4b77-bd58-e2284db8656c on hv-cinder-84146 May 11 21:15:34.495405 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-677be553-9132-4106-8e42-e85531dce14b req-8721187d-87fb-4325-b417-0d7b4cb8f94e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030517 May 11 21:15:34.496530 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 552/1101] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:15:34.908637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-920ac337-6e7d-4016-807a-c56258bc31e2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:34.909585 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-920ac337-6e7d-4016-807a-c56258bc31e2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:34.915543 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-920ac337-6e7d-4016-807a-c56258bc31e2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:34.915996 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-920ac337-6e7d-4016-807a-c56258bc31e2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:34.916762 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-920ac337-6e7d-4016-807a-c56258bc31e2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:34.917193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-920ac337-6e7d-4016-807a-c56258bc31e2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:34.946736 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-920ac337-6e7d-4016-807a-c56258bc31e2 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 May 11 21:15:34.947286 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 550/1102] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:15:34 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:15:35.959096 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-3d35db8a-aa72-433f-910b-6dc756aba96e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:35.960105 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-3d35db8a-aa72-433f-910b-6dc756aba96e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:35.967026 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d35db8a-aa72-433f-910b-6dc756aba96e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:35.967469 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d35db8a-aa72-433f-910b-6dc756aba96e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:35.968237 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d35db8a-aa72-433f-910b-6dc756aba96e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:35.968675 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-3d35db8a-aa72-433f-910b-6dc756aba96e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:35.996043 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-3d35db8a-aa72-433f-910b-6dc756aba96e tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041297 May 11 21:15:35.996593 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 553/1103] 10.222.0.35 () {58 vars in 1301 bytes} [Wed May 11 21:15:35 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 21:15:36.006124 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:36.006616 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:36.012846 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:36.013408 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:36.014201 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:36.014634 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:36.086496 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] HTTP exception thrown: Instance f69317df-5298-4b77-bd58-e2284db8656c is not attached to volume ecc5fca3-2d46-4c1a-9f13-de7180240d28 May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Request method failure captured: May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: DELETE /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments/ecc5fca3-2d46-4c1a-9f13-de7180240d28 HTTP/1.1 May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCbMocTluyLTLfxkKiI0YOnIrrvtLnTuGBwSQRi8DJrdgWu1OvxVIqWOGAoQqm8ZXSWr_pQ2SmOd-OxyqE7mMhlPeVIY_-1Ugqrt8VlDDefr21l0qda-jGn6IoyWZRssxL9qoeSH-oEU5eTiIadWVIuad7Ra2X3fe6HumEropy826NA May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ffc2f645c2fb4fb1baf86bfa44be2d56 May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestMinimumBasicScenario-1534775717 May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:15:36.092232 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestMinimumBasicScenario-1534775717 May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ffc2f645c2fb4fb1baf86bfa44be2d56 May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1534775717 May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestMinimumBasicScenario-1534775717-project May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 5f921c3ec5a44c49a6ee9903e56b6d62 May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestMinimumBasicScenario-1534775717-project May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:15:36.094031 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance f69317df-5298-4b77-bd58-e2284db8656c is not attached to volume ecc5fca3-2d46-4c1a-9f13-de7180240d28 May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'server_id': 'f69317df-5298-4b77-bd58-e2284db8656c', 'id': 'ecc5fca3-2d46-4c1a-9f13-de7180240d28'} May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ecc5fca3-2d46-4c1a-9f13-de7180240d28. May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:15:36.095170 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69317df-5298-4b77-bd58-e2284db8656c is not attached to volume ecc5fca3-2d46-4c1a-9f13-de7180240d28 May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69317df-5298-4b77-bd58-e2284db8656c is not attached to volume ecc5fca3-2d46-4c1a-9f13-de7180240d28 May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:36.096783 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Returning 404 to user: Instance f69317df-5298-4b77-bd58-e2284db8656c is not attached to volume ecc5fca3-2d46-4c1a-9f13-de7180240d28 {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:15:36.098154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4500889a-1c6f-4990-b671-af71afb704c8 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments/ecc5fca3-2d46-4c1a-9f13-de7180240d28" status: 404 len: 154 microversion: 2.1 time: 0.091445 May 11 21:15:36.098154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 551/1104] 10.222.0.35 () {58 vars in 1415 bytes} [Wed May 11 21:15:36 2022] DELETE /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c/os-volume_attachments/ecc5fca3-2d46-4c1a-9f13-de7180240d28 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:15:37.370406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:37.370918 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:37.377646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:37.378093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:37.378850 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:37.379279 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:37.404261 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:15:37.686673 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-80f902f8-3887-44d1-af4a-e79e5d7a3121 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "DELETE /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 204 len: 0 microversion: 2.1 time: 0.319153 May 11 21:15:37.687309 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 554/1105] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:15:37 2022] DELETE /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:15:37.695300 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:37.700256 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:37.702403 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:37.702852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:37.703620 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:37.704055 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:37.836021 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:15:37.843390 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c2693614-9009-4682-9e90-fa38f7900cdd tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1553 microversion: 2.1 time: 0.151879 May 11 21:15:37.843861 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 552/1106] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:37 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:38.861558 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:38.862245 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:38.868516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:38.868945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:38.869737 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:38.870172 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:38.998771 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:15:39.006093 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ef11a110-5df3-4ad6-b49d-88d1e0370826 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1553 microversion: 2.1 time: 0.148734 May 11 21:15:39.006754 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 555/1107] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:38 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:40.022683 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:40.023285 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:40.029941 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:40.031054 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:40.031173 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:40.031552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:40.244324 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f921c3ec5a44c49a6ee9903e56b6d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:15:40.253055 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-dcff1e12-7984-428d-9778-a64aa23f0829 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 200 len: 1553 microversion: 2.1 time: 0.234396 May 11 21:15:40.253641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 553/1108] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:40 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:40.309132 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-fb036e50-2f2c-476c-b407-c4ad2ce31ea3 req-f9b0b37a-e70a-49c8-b117-b46e1ba3ba13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69317df-5298-4b77-bd58-e2284db8656c", "name": "network-vif-deleted", "tag": "a75fd384-059f-48a9-8646-474738a13496"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:15:40.317025 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-fb036e50-2f2c-476c-b407-c4ad2ce31ea3 req-f9b0b37a-e70a-49c8-b117-b46e1ba3ba13 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:40.320409 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-fb036e50-2f2c-476c-b407-c4ad2ce31ea3 req-f9b0b37a-e70a-49c8-b117-b46e1ba3ba13 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:40.328081 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-fb036e50-2f2c-476c-b407-c4ad2ce31ea3 req-f9b0b37a-e70a-49c8-b117-b46e1ba3ba13 service nova] Creating event network-vif-deleted:a75fd384-059f-48a9-8646-474738a13496 for instance f69317df-5298-4b77-bd58-e2284db8656c on hv-cinder-84146 May 11 21:15:40.332981 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-fb036e50-2f2c-476c-b407-c4ad2ce31ea3 req-f9b0b37a-e70a-49c8-b117-b46e1ba3ba13 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093918 May 11 21:15:40.333577 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 556/1109] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:15:41.270202 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:41.270807 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] [instance: f69317df-5298-4b77-bd58-e2284db8656c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:41.277026 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:41.277470 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:41.278740 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:41.279421 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:41.292050 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] HTTP exception thrown: Instance f69317df-5298-4b77-bd58-e2284db8656c could not be found. May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Request method failure captured: May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c HTTP/1.1 May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCbMocTluyLTLfxkKiI0YOnIrrvtLnTuGBwSQRi8DJrdgWu1OvxVIqWOGAoQqm8ZXSWr_pQ2SmOd-OxyqE7mMhlPeVIY_-1Ugqrt8VlDDefr21l0qda-jGn6IoyWZRssxL9qoeSH-oEU5eTiIadWVIuad7Ra2X3fe6HumEropy826NA May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: ffc2f645c2fb4fb1baf86bfa44be2d56 May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestMinimumBasicScenario-1534775717 May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:15:41.294344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/ffc2f645c2fb4fb1baf86bfa44be2d56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestMinimumBasicScenario-1534775717 May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: ffc2f645c2fb4fb1baf86bfa44be2d56 May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1534775717 May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestMinimumBasicScenario-1534775717-project May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 5f921c3ec5a44c49a6ee9903e56b6d62 May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestMinimumBasicScenario-1534775717-project May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance f69317df-5298-4b77-bd58-e2284db8656c could not be found. May 11 21:15:41.295858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'f69317df-5298-4b77-bd58-e2284db8656c'} May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69317df-5298-4b77-bd58-e2284db8656c could not be found. May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:15:41.296803 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69317df-5298-4b77-bd58-e2284db8656c could not be found. May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69317df-5298-4b77-bd58-e2284db8656c could not be found. May 11 21:15:41.298459 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:41.299969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Returning 404 to user: Instance f69317df-5298-4b77-bd58-e2284db8656c could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:15:41.299969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-fd2ceb26-8fe4-4492-95d8-da7028c2ab0a tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c" status: 404 len: 111 microversion: 2.1 time: 0.029524 May 11 21:15:41.299969 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 554/1110] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:41 2022] GET /compute/v2.1/servers/f69317df-5298-4b77-bd58-e2284db8656c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:15:41.306344 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f26d8113-72ad-4465-a7e6-0e66b7859152 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] Calling method '.version_select at 0x7ff892fcaee0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:41.383658 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f26d8113-72ad-4465-a7e6-0e66b7859152 tempest-TestMinimumBasicScenario-1534775717 tempest-TestMinimumBasicScenario-1534775717-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-746266023" status: 202 len: 0 microversion: 2.1 time: 0.081830 May 11 21:15:41.384290 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 557/1111] 10.222.0.35 () {58 vars in 1268 bytes} [Wed May 11 21:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-746266023 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:15:54.894444 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:54.897236 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:54.897349 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-ff138715-e1a8-40d2-ae90-cff9be27278c req-0fa5bf2d-d69b-47b5-8ab2-dee7470b31d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73f6c6a-d23d-42bc-b42c-1dc580fef95c", "tag": "99ecc292-71b0-4268-a0ea-f4af52d014c9"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:15:54.901699 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:54.902147 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:54.903136 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:54.904532 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:54.907669 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ff138715-e1a8-40d2-ae90-cff9be27278c req-0fa5bf2d-d69b-47b5-8ab2-dee7470b31d5 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:54.908182 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-ff138715-e1a8-40d2-ae90-cff9be27278c req-0fa5bf2d-d69b-47b5-8ab2-dee7470b31d5 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:54.918848 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-ff138715-e1a8-40d2-ae90-cff9be27278c req-0fa5bf2d-d69b-47b5-8ab2-dee7470b31d5 service nova] Creating event network-changed:99ecc292-71b0-4268-a0ea-f4af52d014c9 for instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c on hv-cinder-84146 May 11 21:15:54.924724 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-ff138715-e1a8-40d2-ae90-cff9be27278c req-0fa5bf2d-d69b-47b5-8ab2-dee7470b31d5 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032380 May 11 21:15:54.925632 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 558/1112] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:15:54.930504 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:15:55.217453 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-7b5b84b4-8186-4a07-96a7-6dd29a95c91f tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 204 len: 0 microversion: 2.1 time: 0.327316 May 11 21:15:55.218388 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 555/1113] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:15:54 2022] DELETE /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:15:55.227584 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:55.228497 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:55.235858 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:55.236625 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:55.237413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:55.238100 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:55.388719 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:15:55.396561 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-46c80511-aad7-4173-8d30-35856fbf661a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1577 microversion: 2.1 time: 0.173295 May 11 21:15:55.397229 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 559/1114] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:55 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:56.415378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:56.416094 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:56.423661 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:56.424105 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:56.424864 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:56.425291 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:56.624739 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:15:56.632082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-a2a60877-0319-4c87-b62b-1422763b1c8a tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1577 microversion: 2.1 time: 0.220969 May 11 21:15:56.632646 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 556/1115] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:56 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1577 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:57.649687 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:57.650431 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:57.656984 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:57.657433 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:57.658226 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:57.658662 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:57.790578 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:15:57.797943 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-8598e8c5-5077-4325-a008-a7185eaada6d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1458 microversion: 2.1 time: 0.152544 May 11 21:15:57.798506 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 560/1116] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:57 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:57.915714 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-9bed5bf3-9300-4378-a8f5-07d0f197df11 req-2f1a0ea6-1081-4a54-b564-69af0e91b079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73f6c6a-d23d-42bc-b42c-1dc580fef95c", "name": "network-vif-deleted", "tag": "99ecc292-71b0-4268-a0ea-f4af52d014c9"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:15:57.924552 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-9bed5bf3-9300-4378-a8f5-07d0f197df11 req-2f1a0ea6-1081-4a54-b564-69af0e91b079 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:57.930148 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-9bed5bf3-9300-4378-a8f5-07d0f197df11 req-2f1a0ea6-1081-4a54-b564-69af0e91b079 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:57.936498 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-9bed5bf3-9300-4378-a8f5-07d0f197df11 req-2f1a0ea6-1081-4a54-b564-69af0e91b079 service nova] Creating event network-vif-deleted:99ecc292-71b0-4268-a0ea-f4af52d014c9 for instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c on hv-cinder-84146 May 11 21:15:57.941641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-9bed5bf3-9300-4378-a8f5-07d0f197df11 req-2f1a0ea6-1081-4a54-b564-69af0e91b079 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029601 May 11 21:15:57.942204 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 557/1117] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:15:58.814683 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:58.815287 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:58.821666 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:58.822115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:58.822874 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:58.823305 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:58.854936 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:58.855377 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:58.855812 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lazy-loading 'fault' on Instance uuid e73f6c6a-d23d-42bc-b42c-1dc580fef95c {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:15:58.894989 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:15:58.902402 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-f038f2e4-8daa-47a0-92c7-972334f24777 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 200 len: 1230 microversion: 2.1 time: 0.091558 May 11 21:15:58.903006 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 561/1118] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:58 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:15:59.921128 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:15:59.921848 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e73f6c6a-d23d-42bc-b42c-1dc580fef95c] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:15:59.928278 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:59.928722 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:59.929478 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:15:59.929934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:15:59.944685 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] HTTP exception thrown: Instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c could not be found. May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Request method failure captured: May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c HTTP/1.1 May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCWOVqkkcjXaSDlNIvvy8GEGAk65PbYcbcJUYu8Apba3Lbf8WeYkLIvNz3G4QbJnqXYMXlqOxbzcjuVAnMMBUuhbBlWGzIxfCocQSjjSXKyVpgW6i1i2zNkgVL8xBeH9rtkZ7rVroHn1-mY66gSDGCkpP1BTNhXFu2U3po4qJi8-hnI May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:15:59.946298 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-104785076 May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-104785076-project May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 3a47bfbd0a2e459cabaa30d74f45811a May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-104785076-project May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c could not be found. May 11 21:15:59.947849 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'e73f6c6a-d23d-42bc-b42c-1dc580fef95c'} May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c could not be found. May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:15:59.948680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c could not be found. May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c could not be found. May 11 21:15:59.950154 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:15:59.951367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Returning 404 to user: Instance e73f6c6a-d23d-42bc-b42c-1dc580fef95c could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:15:59.951367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c3a13a99-3932-45c4-a8a3-cfe5b40351a7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c" status: 404 len: 111 microversion: 2.1 time: 0.031357 May 11 21:15:59.951367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 558/1119] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:15:59 2022] GET /compute/v2.1/servers/e73f6c6a-d23d-42bc-b42c-1dc580fef95c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:16:03.240247 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:03.240808 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:03.242255 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-306eb4a8-307b-4068-aa91-a8aa7528b241 req-0eef874f-58de-4c2c-9f07-ffd1d6c964e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53feae8-565c-4c97-999c-e6ad67000e66", "tag": "cbd65633-32de-4901-ad79-fb11a88761c8"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:16:03.247545 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:03.248115 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:03.249491 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:03.250105 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:03.251651 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-306eb4a8-307b-4068-aa91-a8aa7528b241 req-0eef874f-58de-4c2c-9f07-ffd1d6c964e3 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:03.252099 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-306eb4a8-307b-4068-aa91-a8aa7528b241 req-0eef874f-58de-4c2c-9f07-ffd1d6c964e3 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:03.264827 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-306eb4a8-307b-4068-aa91-a8aa7528b241 req-0eef874f-58de-4c2c-9f07-ffd1d6c964e3 service nova] Creating event network-changed:cbd65633-32de-4901-ad79-fb11a88761c8 for instance e53feae8-565c-4c97-999c-e6ad67000e66 on hv-cinder-84146 May 11 21:16:03.270461 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-306eb4a8-307b-4068-aa91-a8aa7528b241 req-0eef874f-58de-4c2c-9f07-ffd1d6c964e3 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031915 May 11 21:16:03.271211 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 559/1120] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:16:03.275633 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Going to try to terminate instance {{(pid=117612) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:16:03.554721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5f748185-55f3-405b-a618-8a85a5c75471 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "DELETE /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 204 len: 0 microversion: 2.1 time: 0.318160 May 11 21:16:03.556912 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 562/1121] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:16:03 2022] DELETE /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:16:03.564751 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:03.565436 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:03.573367 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:03.573846 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:03.574616 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:03.575049 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:03.704443 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:03.711911 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-e8b47d97-b6cf-45ae-8186-32bdf6ae01f2 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1578 microversion: 2.1 time: 0.151953 May 11 21:16:03.712474 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 560/1122] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:03 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:04.730224 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:04.730922 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:04.737608 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:04.738065 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:04.738834 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:04.739267 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:04.868657 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:04.876490 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c439bd23-c970-4b69-b3a0-1e829f8018db tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1578 microversion: 2.1 time: 0.150474 May 11 21:16:04.877041 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 563/1123] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:04 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:05.677723 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [req-63d9326b-a70f-4697-be27-5a71c73d8062 req-200eab24-aab1-4260-b691-cf21c24084eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53feae8-565c-4c97-999c-e6ad67000e66", "name": "network-vif-deleted", "tag": "cbd65633-32de-4901-ad79-fb11a88761c8"}]} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:16:05.685808 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-63d9326b-a70f-4697-be27-5a71c73d8062 req-200eab24-aab1-4260-b691-cf21c24084eb service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:05.686248 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [req-63d9326b-a70f-4697-be27-5a71c73d8062 req-200eab24-aab1-4260-b691-cf21c24084eb service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:05.696749 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.compute.server_external_events [req-63d9326b-a70f-4697-be27-5a71c73d8062 req-200eab24-aab1-4260-b691-cf21c24084eb service nova] Creating event network-vif-deleted:cbd65633-32de-4901-ad79-fb11a88761c8 for instance e53feae8-565c-4c97-999c-e6ad67000e66 on hv-cinder-84146 May 11 21:16:05.702127 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [req-63d9326b-a70f-4697-be27-5a71c73d8062 req-200eab24-aab1-4260-b691-cf21c24084eb service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027460 May 11 21:16:05.702698 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 561/1124] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:16:05.894041 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:05.894582 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:05.900821 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:05.901266 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:05.902051 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:05.902483 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:05.967451 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a47bfbd0a2e459cabaa30d74f45811a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:05.975257 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c925dcb2-19ba-4d08-bba5-99d3c983825d tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 200 len: 1225 microversion: 2.1 time: 0.085561 May 11 21:16:05.975920 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 564/1125] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:05 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:16:06.993021 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:06.993690 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: e53feae8-565c-4c97-999c-e6ad67000e66] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:06.999680 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:07.000531 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:07.000885 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:07.001321 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:07.014653 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] HTTP exception thrown: Instance e53feae8-565c-4c97-999c-e6ad67000e66 could not be found. May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Request method failure captured: May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 HTTP/1.1 May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCWOVqkkcjXaSDlNIvvy8GEGAk65PbYcbcJUYu8Apba3Lbf8WeYkLIvNz3G4QbJnqXYMXlqOxbzcjuVAnMMBUuhbBlWGzIxfCocQSjjSXKyVpgW6i1i2zNkgVL8xBeH9rtkZ7rVroHn1-mY66gSDGCkpP1BTNhXFu2U3po4qJi8-hnI May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:16:07.016250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-104785076-project May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 3a47bfbd0a2e459cabaa30d74f45811a May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-104785076-project May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance e53feae8-565c-4c97-999c-e6ad67000e66 could not be found. May 11 21:16:07.017946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'e53feae8-565c-4c97-999c-e6ad67000e66'} May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e53feae8-565c-4c97-999c-e6ad67000e66 could not be found. May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:16:07.019080 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e53feae8-565c-4c97-999c-e6ad67000e66 could not be found. May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e53feae8-565c-4c97-999c-e6ad67000e66 could not be found. May 11 21:16:07.021190 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.022934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Returning 404 to user: Instance e53feae8-565c-4c97-999c-e6ad67000e66 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:16:07.022934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f6a0dab7-0f72-476c-af6a-62fcc87e38bf tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66" status: 404 len: 111 microversion: 2.1 time: 0.029434 May 11 21:16:07.022934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 562/1126] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:06 2022] GET /compute/v2.1/servers/e53feae8-565c-4c97-999c-e6ad67000e66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:16:07.502554 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:07.503066 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:07.509387 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:07.509872 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:07.510644 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:07.511083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:07.524721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.wsgi [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] HTTP exception thrown: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Request method failure captured: May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: request: DELETE /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 HTTP/1.1 May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept: application/json May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Accept-Encoding: identity May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Connection: close May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Length: 0 May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Content-Type: application/json May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Host: 10.222.0.35 May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Openstack-System-Scope: None May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: User-Agent: python-urllib3/1.26.9 May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Auth-Token: gAAAAABifCWOVqkkcjXaSDlNIvvy8GEGAk65PbYcbcJUYu8Apba3Lbf8WeYkLIvNz3G4QbJnqXYMXlqOxbzcjuVAnMMBUuhbBlWGzIxfCocQSjjSXKyVpgW6i1i2zNkgVL8xBeH9rtkZ7rVroHn1-mY66gSDGCkpP1BTNhXFu2U3po4qJi8-hnI May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Id: None May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Domain-Name: None May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Identity-Status: Confirmed May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Is-Admin-Project: True May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Id: default May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Domain-Name: Default May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Project-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Role: member,reader May 11 21:16:07.526406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Roles: member,reader May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-Tenant-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User: tempest-TestVolumeBootPattern-104785076-project May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Id: default May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Domain-Name: Default May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Id: 3a47bfbd0a2e459cabaa30d74f45811a May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: X-User-Name: tempest-TestVolumeBootPattern-104785076-project May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: method: > May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: exception: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.528094 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: action_args: {'id': 'b3855665-64e1-4b51-9e7b-a46354bde903'} May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:16:07.529167 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.531077 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: ERROR nova.api.openstack.wsgi May 11 21:16:07.532693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Returning 404 to user: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. {{(pid=117612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:16:07.532693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ed798b41-e1ee-4ef6-98b8-e1a4bd2fa816 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "DELETE /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 404 len: 111 microversion: 2.1 time: 0.030026 May 11 21:16:07.532693 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 565/1127] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:16:07 2022] DELETE /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:16:07.536549 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:07.537155 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] [instance: b3855665-64e1-4b51-9e7b-a46354bde903] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:07.543047 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:07.543489 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:07.544238 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:07.544670 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:07.557386 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] HTTP exception thrown: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Request method failure captured: May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 HTTP/1.1 May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCWOVqkkcjXaSDlNIvvy8GEGAk65PbYcbcJUYu8Apba3Lbf8WeYkLIvNz3G4QbJnqXYMXlqOxbzcjuVAnMMBUuhbBlWGzIxfCocQSjjSXKyVpgW6i1i2zNkgVL8xBeH9rtkZ7rVroHn1-mY66gSDGCkpP1BTNhXFu2U3po4qJi8-hnI May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:16:07.558892 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/31585e8d8c2b4eb0b052b30e2ce5fa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 31585e8d8c2b4eb0b052b30e2ce5fa63 May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestVolumeBootPattern-104785076 May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestVolumeBootPattern-104785076-project May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 3a47bfbd0a2e459cabaa30d74f45811a May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestVolumeBootPattern-104785076-project May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.561091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': 'b3855665-64e1-4b51-9e7b-a46354bde903'} May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:16:07.562133 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. May 11 21:16:07.563695 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:16:07.565036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Returning 404 to user: Instance b3855665-64e1-4b51-9e7b-a46354bde903 could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:16:07.565036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6123c1d6-890b-41b3-a272-9d881baefd68 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903" status: 404 len: 111 microversion: 2.1 time: 0.027409 May 11 21:16:07.565036 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 563/1128] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:07 2022] GET /compute/v2.1/servers/b3855665-64e1-4b51-9e7b-a46354bde903 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:16:09.021862 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-1738ecaa-02ab-445e-83f7-25bfdc1eb6d7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] Calling method '.version_select at 0x7ff8980b04c0>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:09.115375 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-1738ecaa-02ab-445e-83f7-25bfdc1eb6d7 tempest-TestVolumeBootPattern-104785076 tempest-TestVolumeBootPattern-104785076-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320302024" status: 202 len: 0 microversion: 2.1 time: 0.097324 May 11 21:16:09.115952 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 566/1129] 10.222.0.35 () {58 vars in 1262 bytes} [Wed May 11 21:16:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1320302024 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:16:36.235184 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:16:36.235758 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:36.241664 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:36.242118 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:36.242875 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:36.243310 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:36.265250 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.objects.instance [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lazy-loading 'flavor' on Instance uuid 039766c9-0b97-4a35-ad0e-e319d594de7b {{(pid=117611) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:16:36.470861 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c160a668-ecae-4a28-84d7-0c6b98527ec6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "POST /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b/action" status: 202 len: 0 microversion: 2.1 time: 0.239475 May 11 21:16:36.473282 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 564/1130] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:16:36 2022] POST /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:16:36.480902 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:36.481623 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:36.488400 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:36.488826 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:36.489611 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:36.490041 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:36.618630 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:36.626146 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-87e6a8d3-a7c8-4f37-bc02-869a3eabe895 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.150313 May 11 21:16:36.626701 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 567/1131] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:36 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:37.644393 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:37.645091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:37.651218 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:37.651668 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:37.652466 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:37.652905 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:37.779366 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:37.786978 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f4005bbb-950b-4cc4-8926-a546b5e3961d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.147299 May 11 21:16:37.787534 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 565/1132] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:37 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:38.803843 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:38.804474 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:38.811015 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:38.811461 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:38.812220 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:38.812647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:38.940963 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:38.948302 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a16502b9-7a98-4ff4-86a4-0df324201d73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.148345 May 11 21:16:38.948860 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 568/1133] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:38 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:39.966277 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:39.966889 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:39.973318 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:39.973806 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:39.974613 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:39.975091 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:40.106734 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:40.114523 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-0c95c6f4-0f3f-4e4f-bced-c318dcfeb3d4 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.152143 May 11 21:16:40.115074 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 566/1134] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:39 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:41.131690 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:41.132318 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:41.138562 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:41.139004 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:41.139757 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:41.140190 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:41.267035 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:41.274438 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-797c170e-789e-4229-b1f8-519b874d62b6 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.147178 May 11 21:16:41.274992 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 569/1135] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:41 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:42.291214 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:42.291812 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:42.298052 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:42.298494 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:42.299240 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:42.300176 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:42.425461 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:42.432674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-324b794d-ddb0-4846-8f5e-8281de2c11b0 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.145341 May 11 21:16:42.433225 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 567/1136] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:42 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:43.451410 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:43.452023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:43.458772 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:43.459216 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:43.460001 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:43.460430 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:43.589022 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:43.596287 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a0b7faac-374f-4f2c-9078-d08801032510 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.149429 May 11 21:16:43.597385 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 570/1137] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:43 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:44.052286 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:16:44.052802 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Wed May 11 21:16:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:16:44.614295 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:44.614900 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:44.620906 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:44.621353 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:44.622136 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:44.622566 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:44.749858 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:44.757683 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ec44c183-149c-465e-bcb1-308e52d94e73 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.147796 May 11 21:16:44.758229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 568/1138] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:44 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:45.775234 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:45.775829 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:45.782339 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:45.782788 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:45.783546 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:45.783980 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:45.916515 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:45.923881 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-781f434b-9a73-4455-996b-4325851581ff tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.153013 May 11 21:16:45.924442 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 571/1139] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:45 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 21:16:46.940122 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:46.940727 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:46.947737 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:46.948182 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:46.948946 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:46.949378 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:47.161673 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:47.169488 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d5b097cb-5d56-4f94-8e67-6fcf048bd3d3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.233209 May 11 21:16:47.170058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 569/1140] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:46 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:48.186580 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:48.187197 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:48.193589 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:48.194041 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:48.194799 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:48.195755 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:48.323342 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:48.330820 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-c1a18db2-9561-4647-8193-0a7827b93ad8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.148259 May 11 21:16:48.331377 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 572/1141] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:48 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:49.347484 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:49.348097 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:49.354397 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:49.354852 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:49.355619 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:49.356058 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:49.489121 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:49.497082 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-19cb40a0-0228-4b23-953d-2e63cdee571b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.153495 May 11 21:16:49.497659 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 570/1142] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:49 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:50.514043 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:50.514679 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:50.520945 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:50.521391 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:50.522179 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:50.522615 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:50.652030 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:50.659458 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-ed05d530-7db1-4be3-9614-e3b66a2e1432 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1508 microversion: 2.1 time: 0.149334 May 11 21:16:50.660011 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 573/1143] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:50 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:50.675970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-728fd66d-c185-4fbf-b0ca-76ba6bd2b981 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:16:50.676519 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-728fd66d-c185-4fbf-b0ca-76ba6bd2b981 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:50.682798 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-728fd66d-c185-4fbf-b0ca-76ba6bd2b981 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:50.683242 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-728fd66d-c185-4fbf-b0ca-76ba6bd2b981 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:50.683995 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-728fd66d-c185-4fbf-b0ca-76ba6bd2b981 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:50.684424 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-728fd66d-c185-4fbf-b0ca-76ba6bd2b981 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:50.887043 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-728fd66d-c185-4fbf-b0ca-76ba6bd2b981 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "POST /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b/action" status: 202 len: 0 microversion: 2.1 time: 0.214849 May 11 21:16:50.887641 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 571/1144] 10.222.0.35 () {60 vars in 1277 bytes} [Wed May 11 21:16:50 2022] POST /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:16:50.895721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:50.896329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:50.902904 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:50.903439 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:50.904275 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:50.905083 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:51.032413 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:51.039879 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-59826116-5a9a-43ea-af9c-cfdae2662361 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1516 microversion: 2.1 time: 0.147962 May 11 21:16:51.040406 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 574/1145] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:50 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:52.057991 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:52.058636 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:52.064501 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:52.064952 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:52.065750 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:52.066193 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:52.195616 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:52.201955 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-c80e8e7c-b6fe-4901-b427-d3258c1a0870 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1516 microversion: 2.1 time: 0.148468 May 11 21:16:52.202559 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 572/1146] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:52 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:53.147222 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-531719c6-4b35-4096-b7d5-4ffe51c92146 req-13f134ad-8176-473a-9f07-cc6a92a5bb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039766c9-0b97-4a35-ad0e-e319d594de7b", "name": "network-vif-unplugged", "status": "completed", "tag": "2c41fccc-aa6b-401a-ada6-e084b87e786b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:16:53.155803 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-531719c6-4b35-4096-b7d5-4ffe51c92146 req-13f134ad-8176-473a-9f07-cc6a92a5bb6e service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:53.156464 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-531719c6-4b35-4096-b7d5-4ffe51c92146 req-13f134ad-8176-473a-9f07-cc6a92a5bb6e service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:53.168331 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.compute.server_external_events [req-531719c6-4b35-4096-b7d5-4ffe51c92146 req-13f134ad-8176-473a-9f07-cc6a92a5bb6e service nova] Unable to find a host for instance 039766c9-0b97-4a35-ad0e-e319d594de7b. Dropping event network-vif-unplugged {{(pid=117612) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 21:16:53.169139 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-531719c6-4b35-4096-b7d5-4ffe51c92146 req-13f134ad-8176-473a-9f07-cc6a92a5bb6e service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086353 May 11 21:16:53.169747 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 575/1147] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 11 21:16:53.219739 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:53.221065 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:53.228339 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:53.236674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:53.236674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:53.236674 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:53.364717 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:53.372753 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-d60e7af7-f6db-4cb1-85e6-31eb042d7256 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1518 microversion: 2.1 time: 0.156888 May 11 21:16:53.373316 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 573/1148] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:53 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:54.390454 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:54.390988 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:54.397159 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:54.397647 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:54.398417 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:54.398853 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:54.532227 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:54.539320 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-2e33dcd0-dc2f-45e7-a715-a35f85260976 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.152776 May 11 21:16:54.539884 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 576/1149] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:54 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:55.556068 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:55.556679 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:55.563016 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:55.563468 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:55.564240 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:55.564681 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:55.692357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:55.700165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-de1ea0f1-073c-4390-b2e0-febdd2870354 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.147968 May 11 21:16:55.700727 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 574/1150] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:55 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:56.716760 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:56.717500 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:56.724646 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:56.725116 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:56.726547 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:56.727165 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:56.860539 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:56.868010 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-7a62da66-6b58-4372-bd28-7b7505608add tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.155303 May 11 21:16:56.868566 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 577/1151] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:56 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:57.885140 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:57.885792 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:57.892121 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:57.892573 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:57.893344 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:57.893812 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:58.026168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:58.033621 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-1204c406-73f4-45b4-8a44-a9afc95cc61a tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.152377 May 11 21:16:58.034168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 575/1152] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:57 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:16:59.051118 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:16:59.051682 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:16:59.058432 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:59.058876 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:59.059649 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:16:59.060085 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:16:59.193401 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:16:59.200700 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-5f3ea133-5ef5-4131-8d41-31ac6ed52df3 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.153485 May 11 21:16:59.201253 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 578/1153] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:16:59 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:17:00.217850 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:17:00.218405 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:17:00.224779 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:00.225226 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:00.226505 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:00.226939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:00.350587 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:17:00.358692 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-ac7e44b1-72c5-46ca-ab2d-14134bc36e1b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.144799 May 11 21:17:00.359246 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 576/1154] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:17:00 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:17:01.376138 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:17:01.376743 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:17:01.383559 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:01.383996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:01.384743 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:01.385169 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:01.509828 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:17:01.516962 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-94854c61-9fd9-4a5a-88d3-afd21ca434ba tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.144729 May 11 21:17:01.517511 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 579/1155] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:17:01 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:17:02.534847 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:17:02.535458 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:17:02.542451 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:02.542903 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:02.543671 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:02.544110 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:02.671526 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:17:02.678888 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-215d094d-481f-4e43-a70d-0d35a6a3251d tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.147876 May 11 21:17:02.679445 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 577/1156] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:17:02 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:17:03.695490 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:17:03.696480 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:17:03.702080 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:03.702527 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:03.703294 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:03.703726 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:03.828795 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:17:03.836121 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-bbf13be4-4525-46de-b50a-aaf311fb17af tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.144695 May 11 21:17:03.836677 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 580/1157] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:17:03 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:17:04.852990 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:17:04.853637 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:17:04.859959 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:04.860408 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:04.861169 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:04.861645 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:04.986230 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:17:04.994000 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-788a66c8-b724-4d23-9a37-2aaebaedc7a8 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.144825 May 11 21:17:04.994557 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 578/1158] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:17:04 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:17:05.209175 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-c75202d6-a7d4-44a4-b669-cf73cc85e62c req-73d9d567-8298-43c7-9d76-d87c6c818ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039766c9-0b97-4a35-ad0e-e319d594de7b", "name": "network-vif-plugged", "status": "completed", "tag": "2c41fccc-aa6b-401a-ada6-e084b87e786b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:17:05.217322 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-c75202d6-a7d4-44a4-b669-cf73cc85e62c req-73d9d567-8298-43c7-9d76-d87c6c818ec4 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:05.217781 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-c75202d6-a7d4-44a4-b669-cf73cc85e62c req-73d9d567-8298-43c7-9d76-d87c6c818ec4 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:05.228903 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-c75202d6-a7d4-44a4-b669-cf73cc85e62c req-73d9d567-8298-43c7-9d76-d87c6c818ec4 service nova] Creating event network-vif-plugged:2c41fccc-aa6b-401a-ada6-e084b87e786b for instance 039766c9-0b97-4a35-ad0e-e319d594de7b on hv-cinder-84146 May 11 21:17:05.237926 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-c75202d6-a7d4-44a4-b669-cf73cc85e62c req-73d9d567-8298-43c7-9d76-d87c6c818ec4 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032518 May 11 21:17:05.238563 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 581/1159] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:17:06.010939 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:17:06.011546 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:17:06.017881 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:06.018327 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:06.019086 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:06.019517 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:06.150164 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:17:06.157618 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-4a4c98b6-9fb6-4737-9020-5558f96661be tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1574 microversion: 2.1 time: 0.150951 May 11 21:17:06.158173 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 579/1160] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:17:06 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:17:07.174292 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:17:07.174886 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:17:07.181329 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:07.181806 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:07.182570 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:17:07.183012 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:17:07.313447 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:17:07.320649 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-dbf38b4c-2210-465f-8570-eb147a672e67 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1561 microversion: 2.1 time: 0.150741 May 11 21:17:07.321207 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 582/1161] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:17:07 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:18:21.792691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:18:21.792691 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:18:21.793902 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-05a07c1d-d2e4-44a5-a0e4-2cf89e2acf46 req-a2a317c8-3c65-4940-a454-16440b21e507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039766c9-0b97-4a35-ad0e-e319d594de7b", "tag": "2c41fccc-aa6b-401a-ada6-e084b87e786b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:18:21.794765 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:21.795444 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:21.796238 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:21.796516 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-05a07c1d-d2e4-44a5-a0e4-2cf89e2acf46 req-a2a317c8-3c65-4940-a454-16440b21e507 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:21.796707 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:21.796963 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-05a07c1d-d2e4-44a5-a0e4-2cf89e2acf46 req-a2a317c8-3c65-4940-a454-16440b21e507 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:21.810519 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-05a07c1d-d2e4-44a5-a0e4-2cf89e2acf46 req-a2a317c8-3c65-4940-a454-16440b21e507 service nova] Creating event network-changed:2c41fccc-aa6b-401a-ada6-e084b87e786b for instance 039766c9-0b97-4a35-ad0e-e319d594de7b on hv-cinder-84146 May 11 21:18:21.816262 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-05a07c1d-d2e4-44a5-a0e4-2cf89e2acf46 req-a2a317c8-3c65-4940-a454-16440b21e507 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032258 May 11 21:18:21.821703 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 583/1162] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 21:18:21.823905 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Going to try to terminate instance {{(pid=117611) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 21:18:22.112374 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-03b38bed-f0bc-4603-b9f9-910daaa034a2 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "DELETE /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 204 len: 0 microversion: 2.1 time: 0.330867 May 11 21:18:22.112970 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 580/1163] 10.222.0.35 () {58 vars in 1238 bytes} [Wed May 11 21:18:21 2022] DELETE /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 21:18:22.123169 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:18:22.123398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:18:22.129800 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:22.130250 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:22.131026 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:22.131459 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:22.267588 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:18:22.275382 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-02623296-70e7-42d8-99d0-e621c0e48e21 tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.157763 May 11 21:18:22.275961 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 584/1164] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:18:22 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:18:23.294471 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:18:23.295168 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:18:23.301601 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:23.302060 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:23.302830 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:23.303264 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:23.449883 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:18:23.457402 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-6e27f152-64b2-46bd-9f63-4c3c0cd8424c tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1567 microversion: 2.1 time: 0.167762 May 11 21:18:23.457993 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 581/1165] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:18:23 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:18:24.460707 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [req-4c33d2cc-e449-4978-8966-35d36ad896bd req-907ede0d-7280-4825-b8a6-ad9414599cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039766c9-0b97-4a35-ad0e-e319d594de7b", "name": "network-vif-deleted", "tag": "2c41fccc-aa6b-401a-ada6-e084b87e786b"}]} {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 21:18:24.469897 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-4c33d2cc-e449-4978-8966-35d36ad896bd req-907ede0d-7280-4825-b8a6-ad9414599cc2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:24.470334 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [req-4c33d2cc-e449-4978-8966-35d36ad896bd req-907ede0d-7280-4825-b8a6-ad9414599cc2 service nova] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:24.475247 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:18:24.475863 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:18:24.481389 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.compute.server_external_events [req-4c33d2cc-e449-4978-8966-35d36ad896bd req-907ede0d-7280-4825-b8a6-ad9414599cc2 service nova] Creating event network-vif-deleted:2c41fccc-aa6b-401a-ada6-e084b87e786b for instance 039766c9-0b97-4a35-ad0e-e319d594de7b on hv-cinder-84146 May 11 21:18:24.482292 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:24.482738 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:24.483502 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:24.483934 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:24.486398 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [req-4c33d2cc-e449-4978-8966-35d36ad896bd req-907ede0d-7280-4825-b8a6-ad9414599cc2 service nova] 10.222.0.35 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029347 May 11 21:18:24.489239 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 585/1166] 10.222.0.35 () {64 vars in 1317 bytes} [Wed May 11 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 21:18:24.546480 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.policy [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117611) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:18:24.553929 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-f91a36b0-5621-4b7c-b5d9-5190bab010bd tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1382 microversion: 2.1 time: 0.082720 May 11 21:18:24.554489 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 582/1167] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:18:24 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1382 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:18:25.572784 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:18:25.573475 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.compute.api [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117612) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:18:25.580023 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:25.580471 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:25.581256 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:25.581716 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:25.615266 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:25.615721 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG oslo_concurrency.lockutils [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:25.620901 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.objects.instance [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lazy-loading 'fault' on Instance uuid 039766c9-0b97-4a35-ad0e-e319d594de7b {{(pid=117612) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 21:18:25.661221 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.policy [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05901232e0534f6fa130e78584b703ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715fee0f9c6e4c73b716faa3b978208c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117612) authorize /opt/stack/nova/nova/policy.py:199}} May 11 21:18:25.667996 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-a526888c-109c-4811-8ed7-d8d1c7f2cf9f tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 200 len: 1225 microversion: 2.1 time: 0.099966 May 11 21:18:25.668562 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 586/1168] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:18:25 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 21:18:26.684100 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '>' {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:18:26.684730 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.compute.api [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] [instance: 039766c9-0b97-4a35-ad0e-e319d594de7b] Fetching instance by UUID {{(pid=117611) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 21:18:26.691165 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:26.691606 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:26.692357 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 21:18:26.692786 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG oslo_concurrency.lockutils [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Lock "1807c78b-3bd1-4707-b15d-964e45f54afd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 21:18:26.705464 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.wsgi [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] HTTP exception thrown: Instance 039766c9-0b97-4a35-ad0e-e319d594de7b could not be found. May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Request method failure captured: May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: request: GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b HTTP/1.1 May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept: application/json May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Accept-Encoding: identity May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Connection: close May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Length: 0 May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Content-Type: application/json May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Host: 10.222.0.35 May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Openstack-System-Scope: None May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: User-Agent: python-urllib3/1.26.9 May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Auth-Token: gAAAAABifCcIXwUMMj0Yxxmoi5HL0C7RQsQvWrQkONhF1mjqcw5L27gd4_2putcctu7tUQU7qac9Mf_QGp9NzBhlYymDOYMjeEjXuzlnI0ddmB2ZMfWdcqhUE0bJoBUYuPSXchZjWqBHRDLv1l7apc6eLJi2k-_NUoGnbFJiGepDRP_4Y8iKf-g May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Id: None May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Domain-Name: None May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Identity-Status: Confirmed May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Is-Admin-Project: True May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Id: default May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Domain-Name: Default May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Id: 715fee0f9c6e4c73b716faa3b978208c May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Project-Name: tempest-TestShelveInstance-981724973 May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Role: member,reader May 11 21:18:26.707109 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Roles: member,reader May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2/715fee0f9c6e4c73b716faa3b978208c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.35:8080", "publicURL": "http://10.222.0.35:8080/v1/AUTH_715fee0f9c6e4c73b716faa3b978208c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/715fee0f9c6e4c73b716faa3b978208c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/volume/v3/715fee0f9c6e4c73b716faa3b978208c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.35:9696/"}]}] May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant: tempest-TestShelveInstance-981724973 May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Id: 715fee0f9c6e4c73b716faa3b978208c May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-Tenant-Name: tempest-TestShelveInstance-981724973 May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User: tempest-TestShelveInstance-981724973-project May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Id: default May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Domain-Name: Default May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Id: 05901232e0534f6fa130e78584b703ee May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: X-User-Name: tempest-TestShelveInstance-981724973-project May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: method: > May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: exception: Instance 039766c9-0b97-4a35-ad0e-e319d594de7b could not be found. May 11 21:18:26.708877 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: action_args: {'id': '039766c9-0b97-4a35-ad0e-e319d594de7b'} May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: {{(pid=117611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039766c9-0b97-4a35-ad0e-e319d594de7b could not be found. May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 21:18:26.710015 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039766c9-0b97-4a35-ad0e-e319d594de7b could not be found. May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039766c9-0b97-4a35-ad0e-e319d594de7b could not be found. May 11 21:18:26.711688 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: ERROR nova.api.openstack.wsgi May 11 21:18:26.713237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: DEBUG nova.api.openstack.wsgi [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Returning 404 to user: Instance 039766c9-0b97-4a35-ad0e-e319d594de7b could not be found. {{(pid=117611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 21:18:26.713237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO nova.api.openstack.requestlog [None req-292efaec-8a7a-4137-abee-4951753023fb tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b" status: 404 len: 111 microversion: 2.1 time: 0.028243 May 11 21:18:26.713237 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: [pid: 117611|app: 0|req: 583/1169] 10.222.0.35 () {58 vars in 1235 bytes} [Wed May 11 21:18:26 2022] GET /compute/v2.1/servers/039766c9-0b97-4a35-ad0e-e319d594de7b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 21:18:26.938950 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: DEBUG nova.api.openstack.wsgi [None req-104db198-c534-46e5-afc6-8175529ed68b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] Calling method '.version_select at 0x7ff89807f430>' {{(pid=117612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 21:18:27.004131 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO nova.api.openstack.requestlog [None req-104db198-c534-46e5-afc6-8175529ed68b tempest-TestShelveInstance-981724973 tempest-TestShelveInstance-981724973-project] 10.222.0.35 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1370924965" status: 202 len: 0 microversion: 2.1 time: 0.069092 May 11 21:18:27.004714 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: [pid: 117612|app: 0|req: 587/1170] 10.222.0.35 () {58 vars in 1253 bytes} [Wed May 11 21:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1370924965 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 21:19:49.791228 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:19:49.791931 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Wed May 11 21:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:20:04.060642 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:20:04.061229 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Wed May 11 21:20:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:21:37.672575 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:21:37.673215 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Wed May 11 21:21:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:21:53.667266 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:21:53.667811 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Wed May 11 21:21:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:23:09.799552 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:23:09.800193 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Wed May 11 21:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:23:24.069143 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:23:24.069700 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Wed May 11 21:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:23:25.831411 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:23:25.831941 dv-cinder-841467-1-iscsi devstack@n-api.service[117612]: Wed May 11 21:23:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 21:23:39.059633 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 21:23:39.060144 dv-cinder-841467-1-iscsi devstack@n-api.service[117611]: Wed May 11 21:23:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!